2025-12-04 10:00:25 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2025-12-04 10:00:25 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2025-12-04 10:00:25 [manheim.gb] INFO: Starting spider manheim.gb
2025-12-04 10:00:25 [scrapy.addons] INFO: Enabled addons:
[]
2025-12-04 10:00:25 [asyncio] DEBUG: Using selector: EpollSelector
2025-12-04 10:00:25 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2025-12-04 10:00:25 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2025-12-04 10:00:25 [scrapy.extensions.telnet] INFO: Telnet Password: c3ec86532487afc6
2025-12-04 10:00:25 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2025-12-04 10:00:25 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/manheim.gb/task_37_2025-12-04T10_00_04.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2025-12-04 10:00:25 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2025-12-04 10:00:25 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2025-12-04 10:00:25 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2025-12-04 10:00:25 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2025-12-04 10:00:25 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2025-12-04 10:00:25 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2025-12-04 10:00:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:00:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:00:25 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2025-12-04 10:00:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2025-12-04 10:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:00:25 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2025-12-04 10:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2025-12-04 10:00:25 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2025-12-04 10:00:25 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: low_mileage_for_country.json
2025-12-04 10:00:25 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage.json
2025-12-04 10:00:25 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2025-12-04 10:00:25 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2025-12-04 10:00:25 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2025-12-04 10:00:25 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2025-12-04 10:00:25 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2025-12-04 10:00:25 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2025-12-04 10:00:25 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2025-12-04 10:00:25 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2025-12-04 10:00:25 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: cars_too_new_for_country.json
2025-12-04 10:00:25 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_price_for_currency.json
2025-12-04 10:00:25 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2025-12-04 10:00:25 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2025-12-04 10:00:25 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2025-12-04 10:00:25 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2025-12-04 10:00:25 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage_for_country.json
2025-12-04 10:00:25 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2025-12-04 10:00:25 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2025-12-04 10:00:25 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2025-12-04 10:00:25 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2025-12-04 10:00:25 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2025-12-04 10:00:25 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: registration_date_old.json
2025-12-04 10:00:25 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage_for_make.json
2025-12-04 10:00:25 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2025-12-04 10:00:25 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2025-12-04 10:00:25 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2025-12-04 10:00:25 [scrapy.core.engine] INFO: Spider opened
2025-12-04 10:00:25 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2025-12-04 10:00:26 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6024
2025-12-04 10:00:26 [scrapy-playwright] INFO: Starting download handler
2025-12-04 10:00:26 [scrapy-playwright] INFO: Starting download handler
2025-12-04 10:00:30 [scrapy-playwright] INFO: Launching browser firefox
2025-12-04 10:00:31 [scrapy-playwright] INFO: Browser firefox launched
2025-12-04 10:00:31 [scrapy-playwright] DEBUG: Browser context started: 'default' (persistent=False, remote=False)
2025-12-04 10:00:32 [scrapy-playwright] DEBUG: [Context=default] New page created, page count is 1 (1 for all contexts)
2025-12-04 10:00:32 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/> (resource type: document)
2025-12-04 10:00:32 [scrapy-playwright] DEBUG: [Context=default] Response: <407 https://www.manheim.co.uk/>
2025-12-04 10:00:32 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/> (resource type: document)
2025-12-04 10:00:34 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/>
2025-12-04 10:00:35 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/bundle?v=HcGNblHj64wK-Istb_0SemQAL-rwtK13kDPW8q3LCIo1> (resource type: stylesheet, referrer: https://www.manheim.co.uk/)
2025-12-04 10:00:35 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/bundles/delete/scripts/homepage?v=CIpuZXIp0V7i0j1sjTB9sUemSg9-D9w8k891UP0sReI1> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-04 10:00:35 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/top_navigationlogo.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-04 10:00:35 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/top_navigationlogo.ashx?la=en>
2025-12-04 10:00:35 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/homepage_new.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-04 10:00:35 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/homepage_new.ashx?la=en>
2025-12-04 10:00:35 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/auction-centre-pages/auction-centre-c114-treated--hero.ashx?la=en&mw=960> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-04 10:00:35 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/auction-centre-pages/auction-centre-c114-treated--hero.ashx?la=en&mw=960>
2025-12-04 10:00:35 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/new-website-images-2021/vehicle-solutions/vs-3.ashx?la=en&mw=960> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-04 10:00:35 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/new-website-images-2021/vehicle-solutions/vs-3.ashx?la=en&mw=960>
2025-12-04 10:00:35 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/inspections-and-collections/inspections-and-collections-b87-treated---hero.ashx?la=en&mw=960> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-04 10:00:35 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/inspections-and-collections/inspections-and-collections-b87-treated---hero.ashx?la=en&mw=960>
2025-12-04 10:00:35 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimvehiclesearchpage2.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-04 10:00:35 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimvehiclesearchpage2.ashx?la=en>
2025-12-04 10:00:35 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/Scripts/Manheim/tellnumberchange.js> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-04 10:00:35 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/Scripts/Manheim/RemoveSignUpBanner.js> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-04 10:00:35 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/bundle?v=HcGNblHj64wK-Istb_0SemQAL-rwtK13kDPW8q3LCIo1>
2025-12-04 10:00:35 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/jquery-ui-1.13.2.min.css> (resource type: stylesheet, referrer: https://www.manheim.co.uk/assets/css/bundle?v=HcGNblHj64wK-Istb_0SemQAL-rwtK13kDPW8q3LCIo1)
2025-12-04 10:00:35 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/core-blessed1.min.css> (resource type: stylesheet, referrer: https://www.manheim.co.uk/assets/css/bundle?v=HcGNblHj64wK-Istb_0SemQAL-rwtK13kDPW8q3LCIo1)
2025-12-04 10:00:35 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/bundles/delete/scripts/homepage?v=CIpuZXIp0V7i0j1sjTB9sUemSg9-D9w8k891UP0sReI1>
2025-12-04 10:00:35 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/Scripts/Manheim/tellnumberchange.js>
2025-12-04 10:00:35 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/Scripts/Manheim/RemoveSignUpBanner.js>
2025-12-04 10:00:35 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/jquery-ui-1.13.2.min.css>
2025-12-04 10:00:35 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/core-blessed1.min.css>
2025-12-04 10:00:35 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Light.woff> (resource type: font, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-04 10:00:36 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.googletagmanager.com/gtm.js?id=GTM-KZS96H> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-04 10:00:36 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/top_navigationlogo.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-04 10:00:36 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.googletagmanager.com/gtm.js?id=GTM-KZS96H>
2025-12-04 10:00:36 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/homepage_new.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-04 10:00:36 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/top_navigationlogo.ashx?la=en>
2025-12-04 10:00:36 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/homepage_new.ashx?la=en>
2025-12-04 10:00:36 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/auction-centre-pages/auction-centre-c114-treated--hero.ashx?la=en&mw=960> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-04 10:00:36 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/auction-centre-pages/auction-centre-c114-treated--hero.ashx?la=en&mw=960>
2025-12-04 10:00:36 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/new-website-images-2021/vehicle-solutions/vs-3.ashx?la=en&mw=960> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-04 10:00:36 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/new-website-images-2021/vehicle-solutions/vs-3.ashx?la=en&mw=960>
2025-12-04 10:00:36 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/inspections-and-collections/inspections-and-collections-b87-treated---hero.ashx?la=en&mw=960> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-04 10:00:36 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/inspections-and-collections/inspections-and-collections-b87-treated---hero.ashx?la=en&mw=960>
2025-12-04 10:00:36 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimvehiclesearchpage2.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-04 10:00:36 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimvehiclesearchpage2.ashx?la=en>
2025-12-04 10:00:36 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/images/filters/dot_pattern.png> (resource type: image, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-04 10:00:36 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/assets/images/filters/dot_pattern.png>
2025-12-04 10:00:36 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/images/branding/dropdown.png> (resource type: image, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-04 10:00:36 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/assets/images/branding/dropdown.png>
2025-12-04 10:00:36 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Regular.woff> (resource type: font, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-04 10:00:36 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Bold.woff> (resource type: font, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-04 10:00:36 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/fonts/Manheim-Icons/Manheim-Icons.woff> (resource type: font, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-04 10:00:36 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://www.manheim.co.uk/Account/IsCookieExist> (resource type: xhr, referrer: https://www.manheim.co.uk/)
2025-12-04 10:00:36 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/buying-options/buying-options-c153-treated--hero.ashx?la=en&mw=1920> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-04 10:00:36 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/buying-options/buying-options-c153-treated--hero.ashx?la=en&mw=1920>
2025-12-04 10:00:36 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/manheimcolchester10.ashx?la=en&mw=1920> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-04 10:00:36 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/manheimcolchester10.ashx?la=en&mw=1920>
2025-12-04 10:00:36 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/auction-centre-pages/auction-centre-8665-treated--hero.ashx?la=en&mw=1920> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-04 10:00:36 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/auction-centre-pages/auction-centre-8665-treated--hero.ashx?la=en&mw=1920>
2025-12-04 10:00:36 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Light.woff>
2025-12-04 10:00:36 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Regular.woff>
2025-12-04 10:00:36 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Bold.woff>
2025-12-04 10:00:36 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/fonts/Manheim-Icons/Manheim-Icons.woff>
2025-12-04 10:00:36 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/Account/IsCookieExist>
2025-12-04 10:00:36 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://js-agent.newrelic.com/nr-spa-1.303.0.min.js> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-04 10:00:36 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://js-agent.newrelic.com/nr-spa-1.303.0.min.js>
2025-12-04 10:00:36 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://pi.pardot.com/pd.js> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-04 10:00:36 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://js-agent.newrelic.com/nr-spa-1.303.0.min.js> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-04 10:00:36 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://js-agent.newrelic.com/nr-spa-1.303.0.min.js>
2025-12-04 10:00:38 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://pi.pardot.com/pd.js>
2025-12-04 10:00:38 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://pi.pardot.com/analytics?ver=3&visitor_id=&visitor_id_sign=&pi_opt_in=&campaign_id=24684&account_id=38592&title=Manheim%20%7C%20Auctions%2C%20Vehicle%20Solutions%20%26%20Remarketing&url=https%3A%2F%2Fwww.manheim.co.uk%2F&referrer=> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-04 10:00:38 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://pi.pardot.com/analytics?ver=3&visitor_id=&visitor_id_sign=&pi_opt_in=&campaign_id=24684&account_id=38592&title=Manheim%20%7C%20Auctions%2C%20Vehicle%20Solutions%20%26%20Remarketing&url=https%3A%2F%2Fwww.manheim.co.uk%2F&referrer=>
2025-12-04 10:00:38 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://brands.coxauto.co.uk/analytics?conly=true&visitor_id=918909309&visitor_id_sign=f8aeb18f79c36cf6c9741a5db36a2a21aaa2020d7784b686f9fad4f66ce216e86d09feab4192b3c53a03cfc3eeae1c52d4068699&pi_opt_in=&campaign_id=24684&account_id=38592&title=Manheim%20%7C%20Auctions%2C%20Vehicle%20Solutions%20%26%20Remarketing&url=https%3A%2F%2Fwww.manheim.co.uk%2F&referrer=> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-04 10:00:39 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://brands.coxauto.co.uk/analytics?conly=true&visitor_id=918909309&visitor_id_sign=f8aeb18f79c36cf6c9741a5db36a2a21aaa2020d7784b686f9fad4f66ce216e86d09feab4192b3c53a03cfc3eeae1c52d4068699&pi_opt_in=&campaign_id=24684&account_id=38592&title=Manheim%20%7C%20Auctions%2C%20Vehicle%20Solutions%20%26%20Remarketing&url=https%3A%2F%2Fwww.manheim.co.uk%2F&referrer=>
2025-12-04 10:00:46 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://www.manheim.co.uk/account/login> (resource type: document, referrer: https://www.manheim.co.uk/)
2025-12-04 10:00:47 [scrapy-playwright] DEBUG: [Context=default] Response: <302 https://www.manheim.co.uk/account/login> (location: /mymanheim/dashboard)
2025-12-04 10:00:47 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/mymanheim/dashboard> (resource type: document, referrer: https://www.manheim.co.uk/)
2025-12-04 10:00:53 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/mymanheim/dashboard>
2025-12-04 10:00:53 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/bundle?v=HcGNblHj64wK-Istb_0SemQAL-rwtK13kDPW8q3LCIo1> (resource type: stylesheet, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 10:00:53 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/bundles/delete/scripts/postlogin?v=Bwe963dGqUB3Sdny8E3tKSL2gV9GDgLwX1g6Gq6KF-A1> (resource type: script, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 10:00:53 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/SignalR/Hubs> (resource type: script, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 10:00:53 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimwhitecoxautomotive3.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 10:00:53 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimwhitecoxautomotive3.ashx?la=en>
2025-12-04 10:00:53 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/Scripts/jquery-ui-1.12.1.js> (resource type: script, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 10:00:53 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/Content/myManheim.css> (resource type: stylesheet, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 10:00:53 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/bundles/simulcast?v=P7s0oLmuXc3p3WQNs8URnZ4NaK3K6qkWLOwf0uOs5gw1> (resource type: script, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 10:00:53 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/Content/dashboards.css> (resource type: stylesheet, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 10:00:53 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/new-manheim-booking.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 10:00:53 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/new-manheim-booking.ashx?la=en>
2025-12-04 10:00:53 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/blog/2025/gavel_2025.ashx?h=176&la=en&w=210&crop=1> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 10:00:53 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/blog/2025/gavel_2025.ashx?h=176&la=en&w=210&crop=1>
2025-12-04 10:00:53 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/img_6251.ashx?h=176&la=en&w=210&crop=1> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 10:00:53 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/img_6251.ashx?h=176&la=en&w=210&crop=1>
2025-12-04 10:00:53 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/movex/payg1.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 10:00:53 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/movex/payg1.ashx?la=en>
2025-12-04 10:00:53 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/v3--design11918banner535x191px-(1).ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 10:00:53 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/v3--design11918banner535x191px-(1).ashx?la=en>
2025-12-04 10:00:53 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/campaigns/nama/nama-lcv-location-banner.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 10:00:53 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/campaigns/nama/nama-lcv-location-banner.ashx?la=en>
2025-12-04 10:00:53 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/movex/why_pay_more.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 10:00:53 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/movex/why_pay_more.ashx?la=en>
2025-12-04 10:00:53 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/banners-and-adverts/products-services/simulcast_banner.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 10:00:53 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/banners-and-adverts/products-services/simulcast_banner.ashx?la=en>
2025-12-04 10:00:53 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimlogofooter2.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 10:00:53 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimlogofooter2.ashx?la=en>
2025-12-04 10:00:53 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimvehiclesearchpage2.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 10:00:53 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimvehiclesearchpage2.ashx?la=en>
2025-12-04 10:00:53 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/Scripts/Manheim/tellnumberchange.js> (resource type: script, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 10:00:53 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/Scripts/Manheim/RemoveSignUpBanner.js> (resource type: script, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 10:00:53 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/bundle?v=HcGNblHj64wK-Istb_0SemQAL-rwtK13kDPW8q3LCIo1>
2025-12-04 10:00:53 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/jquery-ui-1.13.2.min.css> (resource type: stylesheet, referrer: https://www.manheim.co.uk/assets/css/bundle?v=HcGNblHj64wK-Istb_0SemQAL-rwtK13kDPW8q3LCIo1)
2025-12-04 10:00:53 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/core-blessed1.min.css> (resource type: stylesheet, referrer: https://www.manheim.co.uk/assets/css/bundle?v=HcGNblHj64wK-Istb_0SemQAL-rwtK13kDPW8q3LCIo1)
2025-12-04 10:00:53 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/bundles/delete/scripts/postlogin?v=Bwe963dGqUB3Sdny8E3tKSL2gV9GDgLwX1g6Gq6KF-A1>
2025-12-04 10:00:55 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/SignalR/Hubs>
2025-12-04 10:00:55 [scrapy-playwright] DEBUG: [Context=default] Response: <302 https://www.manheim.co.uk/Scripts/jquery-ui-1.12.1.js> (location: https://www.manheim.co.uk/404)
2025-12-04 10:00:55 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/Content/myManheim.css>
2025-12-04 10:00:55 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/404> (resource type: script, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 10:00:55 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/bundles/simulcast?v=P7s0oLmuXc3p3WQNs8URnZ4NaK3K6qkWLOwf0uOs5gw1>
2025-12-04 10:00:55 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/Content/dashboards.css>
2025-12-04 10:00:55 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/Scripts/Manheim/tellnumberchange.js>
2025-12-04 10:00:55 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/Scripts/Manheim/RemoveSignUpBanner.js>
2025-12-04 10:00:55 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/jquery-ui-1.13.2.min.css>
2025-12-04 10:00:55 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/core-blessed1.min.css>
2025-12-04 10:00:55 [scrapy-playwright] DEBUG: [Context=default] Response: <404 https://www.manheim.co.uk/404>
2025-12-04 10:00:55 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Light.woff> (resource type: font, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-04 10:00:56 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimwhitecoxautomotive3.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 10:00:56 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Regular.woff> (resource type: font, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-04 10:00:56 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/fonts/Manheim-Icons/Manheim-Icons.woff> (resource type: font, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-04 10:00:56 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/new-manheim-booking.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 10:00:56 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/blog/2025/gavel_2025.ashx?h=176&la=en&w=210&crop=1> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 10:00:56 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/img_6251.ashx?h=176&la=en&w=210&crop=1> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 10:00:56 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimwhitecoxautomotive3.ashx?la=en>
2025-12-04 10:00:56 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/new-manheim-booking.ashx?la=en>
2025-12-04 10:00:56 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/movex/payg1.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 10:00:56 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/blog/2025/gavel_2025.ashx?h=176&la=en&w=210&crop=1>
2025-12-04 10:00:56 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/v3--design11918banner535x191px-(1).ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 10:00:56 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/img_6251.ashx?h=176&la=en&w=210&crop=1>
2025-12-04 10:00:56 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/movex/payg1.ashx?la=en>
2025-12-04 10:00:56 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/v3--design11918banner535x191px-(1).ashx?la=en>
2025-12-04 10:00:56 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/campaigns/nama/nama-lcv-location-banner.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 10:00:56 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/campaigns/nama/nama-lcv-location-banner.ashx?la=en>
2025-12-04 10:00:56 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/movex/why_pay_more.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 10:00:56 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/movex/why_pay_more.ashx?la=en>
2025-12-04 10:00:56 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/banners-and-adverts/products-services/simulcast_banner.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 10:00:56 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/banners-and-adverts/products-services/simulcast_banner.ashx?la=en>
2025-12-04 10:00:56 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimlogofooter2.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 10:00:56 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimlogofooter2.ashx?la=en>
2025-12-04 10:00:56 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimvehiclesearchpage2.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 10:00:56 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimvehiclesearchpage2.ashx?la=en>
2025-12-04 10:00:56 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.googletagmanager.com/gtm.js?id=GTM-KZS96H> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-04 10:00:56 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.googletagmanager.com/gtm.js?id=GTM-KZS96H>
2025-12-04 10:00:56 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/images/branding/dropdown.png> (resource type: image, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-04 10:00:56 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/assets/images/branding/dropdown.png>
2025-12-04 10:00:56 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Light.woff>
2025-12-04 10:00:56 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Bold.woff> (resource type: font, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-04 10:00:56 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/images/thickbox/loadingAnimation.gif> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 10:00:56 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/assets/images/thickbox/loadingAnimation.gif>
2025-12-04 10:00:56 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://www.manheim.co.uk/Account/IsCookieExist> (resource type: xhr, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 10:00:56 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Regular.woff>
2025-12-04 10:00:56 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/fonts/Manheim-Icons/Manheim-Icons.woff>
2025-12-04 10:00:56 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Bold.woff>
2025-12-04 10:00:56 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/Account/IsCookieExist>
2025-12-04 10:00:56 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://js-agent.newrelic.com/nr-spa-1.303.0.min.js> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-04 10:00:56 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://js-agent.newrelic.com/nr-spa-1.303.0.min.js>
2025-12-04 10:00:56 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://pi.pardot.com/pd.js> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-04 10:00:56 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://js-agent.newrelic.com/nr-spa-1.303.0.min.js> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-04 10:00:56 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://js-agent.newrelic.com/nr-spa-1.303.0.min.js>
2025-12-04 10:00:56 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://pi.pardot.com/pd.js>
2025-12-04 10:00:56 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://pi.pardot.com/analytics?ver=3&visitor_id=918909309&visitor_id_sign=f8aeb18f79c36cf6c9741a5db36a2a21aaa2020d7784b686f9fad4f66ce216e86d09feab4192b3c53a03cfc3eeae1c52d4068699&pi_opt_in=&campaign_id=24684&account_id=38592&title=Dashboard%20%7C%20Manheim&url=https%3A%2F%2Fwww.manheim.co.uk%2Fmymanheim%2Fdashboard&referrer=https%3A%2F%2Fwww.manheim.co.uk%2F> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-04 10:00:57 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://pi.pardot.com/analytics?ver=3&visitor_id=918909309&visitor_id_sign=f8aeb18f79c36cf6c9741a5db36a2a21aaa2020d7784b686f9fad4f66ce216e86d09feab4192b3c53a03cfc3eeae1c52d4068699&pi_opt_in=&campaign_id=24684&account_id=38592&title=Dashboard%20%7C%20Manheim&url=https%3A%2F%2Fwww.manheim.co.uk%2Fmymanheim%2Fdashboard&referrer=https%3A%2F%2Fwww.manheim.co.uk%2F>
2025-12-04 10:00:57 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://brands.coxauto.co.uk/analytics?conly=true&visitor_id=918909309&visitor_id_sign=f8aeb18f79c36cf6c9741a5db36a2a21aaa2020d7784b686f9fad4f66ce216e86d09feab4192b3c53a03cfc3eeae1c52d4068699&pi_opt_in=&campaign_id=24684&account_id=38592&title=Dashboard%20%7C%20Manheim&url=https%3A%2F%2Fwww.manheim.co.uk%2Fmymanheim%2Fdashboard&referrer=https%3A%2F%2Fwww.manheim.co.uk%2F> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-04 10:00:58 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://brands.coxauto.co.uk/analytics?conly=true&visitor_id=918909309&visitor_id_sign=f8aeb18f79c36cf6c9741a5db36a2a21aaa2020d7784b686f9fad4f66ce216e86d09feab4192b3c53a03cfc3eeae1c52d4068699&pi_opt_in=&campaign_id=24684&account_id=38592&title=Dashboard%20%7C%20Manheim&url=https%3A%2F%2Fwww.manheim.co.uk%2Fmymanheim%2Fdashboard&referrer=https%3A%2F%2Fwww.manheim.co.uk%2F>
2025-12-04 10:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk> (referer: None) ['playwright']
2025-12-04 10:01:01 [manheim.gb] INFO: Cookies from Playwright: [{'name': 'ASP.NET_SessionId', 'value': '2w0k1lsvqb3oi3zuxibxguvr', 'domain': 'www.manheim.co.uk', 'path': '/', 'expires': -1, 'httpOnly': True, 'secure': True, 'sameSite': 'Lax'}, {'name': '__RequestVerificationToken', 'value': 'AMhnemRTXLRxrQJORR-0M-FB9--pN2GFBinatp3yLphsaAsIjCkhFK1emhEfVkEG3jelMBq5vRH8e0MJA4ALUOM0Vwk1', 'domain': 'www.manheim.co.uk', 'path': '/', 'expires': -1, 'httpOnly': True, 'secure': True, 'sameSite': 'None'}, {'name': 'cb-enabled', 'value': 'enabled', 'domain': 'www.manheim.co.uk', 'path': '/', 'expires': 1796378435, 'httpOnly': False, 'secure': False, 'sameSite': 'None'}, {'name': 'remarketing-web', 'value': '1639ADF847F025C5C45B3D699787E7E0F8EEE11BE718D9258F28FC400E53498BCF7E03D9728E4BA3629F4768FB8F06E4E25CACF05403690B06EA088130712AD8EB3CFFDD13B7DEC7D1E67324A112812BF300802F122934BD4E23233582FBF107B41E29171DEE8E9EF102660A67321220515AD6EC', 'domain': 'www.manheim.co.uk', 'path': '/', 'expires': -1, 'httpOnly': True, 'secure': True, 'sameSite': 'None'}, {'name': 'visitor_id37592', 'value': '918909309', 'domain': 'www.manheim.co.uk', 'path': '/', 'expires': 1796378457, 'httpOnly': False, 'secure': False, 'sameSite': 'None'}, {'name': 'visitor_id37592-hash', 'value': 'f8aeb18f79c36cf6c9741a5db36a2a21aaa2020d7784b686f9fad4f66ce216e86d09feab4192b3c53a03cfc3eeae1c52d4068699', 'domain': 'www.manheim.co.uk', 'path': '/', 'expires': 1796378457, 'httpOnly': False, 'secure': False, 'sameSite': 'None'}, {'name': 'visitor_id37592', 'value': '918909309', 'domain': 'brands.coxauto.co.uk', 'path': '/', 'expires': 1796378458, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}, {'name': 'visitor_id37592-hash', 'value': 'f8aeb18f79c36cf6c9741a5db36a2a21aaa2020d7784b686f9fad4f66ce216e86d09feab4192b3c53a03cfc3eeae1c52d4068699', 'domain': 'brands.coxauto.co.uk', 'path': '/', 'expires': 1796378458, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}, {'name': 'visitor_id37592', 'value': '918909309', 'domain': '.pardot.com', 'path': '/', 'expires': 1796378457, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}, {'name': 'visitor_id37592-hash', 'value': 'f8aeb18f79c36cf6c9741a5db36a2a21aaa2020d7784b686f9fad4f66ce216e86d09feab4192b3c53a03cfc3eeae1c52d4068699', 'domain': '.pardot.com', 'path': '/', 'expires': 1796378457, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}, {'name': 'lpv37592', 'value': 'aHR0cHM6Ly93d3cubWFuaGVpbS5jby51ay9teW1hbmhlaW0vZGFzaGJvYXJk', 'domain': 'pi.pardot.com', 'path': '/', 'expires': 1764844257, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}]
2025-12-04 10:01:01 [manheim.gb] INFO: Scrapy-formatted cookies: [{'name': 'ASP.NET_SessionId', 'value': '2w0k1lsvqb3oi3zuxibxguvr', 'domain': 'www.manheim.co.uk', 'path': '/'}, {'name': '__RequestVerificationToken', 'value': 'AMhnemRTXLRxrQJORR-0M-FB9--pN2GFBinatp3yLphsaAsIjCkhFK1emhEfVkEG3jelMBq5vRH8e0MJA4ALUOM0Vwk1', 'domain': 'www.manheim.co.uk', 'path': '/'}, {'name': 'cb-enabled', 'value': 'enabled', 'domain': 'www.manheim.co.uk', 'path': '/'}, {'name': 'remarketing-web', 'value': '1639ADF847F025C5C45B3D699787E7E0F8EEE11BE718D9258F28FC400E53498BCF7E03D9728E4BA3629F4768FB8F06E4E25CACF05403690B06EA088130712AD8EB3CFFDD13B7DEC7D1E67324A112812BF300802F122934BD4E23233582FBF107B41E29171DEE8E9EF102660A67321220515AD6EC', 'domain': 'www.manheim.co.uk', 'path': '/'}, {'name': 'visitor_id37592', 'value': '918909309', 'domain': 'www.manheim.co.uk', 'path': '/'}, {'name': 'visitor_id37592-hash', 'value': 'f8aeb18f79c36cf6c9741a5db36a2a21aaa2020d7784b686f9fad4f66ce216e86d09feab4192b3c53a03cfc3eeae1c52d4068699', 'domain': 'www.manheim.co.uk', 'path': '/'}, {'name': 'visitor_id37592', 'value': '918909309', 'domain': 'brands.coxauto.co.uk', 'path': '/'}, {'name': 'visitor_id37592-hash', 'value': 'f8aeb18f79c36cf6c9741a5db36a2a21aaa2020d7784b686f9fad4f66ce216e86d09feab4192b3c53a03cfc3eeae1c52d4068699', 'domain': 'brands.coxauto.co.uk', 'path': '/'}, {'name': 'visitor_id37592', 'value': '918909309', 'domain': '.pardot.com', 'path': '/'}, {'name': 'visitor_id37592-hash', 'value': 'f8aeb18f79c36cf6c9741a5db36a2a21aaa2020d7784b686f9fad4f66ce216e86d09feab4192b3c53a03cfc3eeae1c52d4068699', 'domain': '.pardot.com', 'path': '/'}, {'name': 'lpv37592', 'value': 'aHR0cHM6Ly93d3cubWFuaGVpbS5jby51ay9teW1hbmhlaW0vZGFzaGJvYXJk', 'domain': 'pi.pardot.com', 'path': '/'}]
2025-12-04 10:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /SpiderData(PartitionKey='Manheim',RowKey='cookies') HTTP/1.1" 204 0
2025-12-04 10:01:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 10:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/refine> (referer: https://www.manheim.co.uk/search) ['zyte-api']
2025-12-04 10:01:04 [manheim.gb] INFO: Found listing with ID: 1005857
2025-12-04 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271005857%27 HTTP/1.1" 200 None
2025-12-04 10:01:04 [manheim.gb] INFO: Scrape type for 1005857: 0
2025-12-04 10:01:04 [manheim.gb] INFO: Found listing with ID: 1019262
2025-12-04 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271019262%27 HTTP/1.1" 200 None
2025-12-04 10:01:04 [manheim.gb] INFO: Scrape type for 1019262: 0
2025-12-04 10:01:04 [manheim.gb] INFO: Found listing with ID: 1078284
2025-12-04 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271078284%27 HTTP/1.1" 200 None
2025-12-04 10:01:04 [manheim.gb] INFO: Scrape type for 1078284: 0
2025-12-04 10:01:04 [manheim.gb] INFO: Found listing with ID: 1101758
2025-12-04 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271101758%27 HTTP/1.1" 200 None
2025-12-04 10:01:04 [manheim.gb] INFO: Scrape type for 1101758: 0
2025-12-04 10:01:04 [manheim.gb] INFO: Found listing with ID: 1104811
2025-12-04 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271104811%27 HTTP/1.1" 200 None
2025-12-04 10:01:04 [manheim.gb] INFO: Scrape type for 1104811: 0
2025-12-04 10:01:04 [manheim.gb] INFO: Found listing with ID: 1127441
2025-12-04 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271127441%27 HTTP/1.1" 200 None
2025-12-04 10:01:04 [manheim.gb] INFO: Scrape type for 1127441: 0
2025-12-04 10:01:04 [manheim.gb] INFO: Found listing with ID: 1153610
2025-12-04 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271153610%27 HTTP/1.1" 200 None
2025-12-04 10:01:04 [manheim.gb] INFO: Scrape type for 1153610: 0
2025-12-04 10:01:04 [manheim.gb] INFO: Found listing with ID: 1173100
2025-12-04 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271173100%27 HTTP/1.1" 200 None
2025-12-04 10:01:04 [manheim.gb] INFO: Scrape type for 1173100: 0
2025-12-04 10:01:04 [manheim.gb] INFO: Found listing with ID: 1191100
2025-12-04 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271191100%27 HTTP/1.1" 200 None
2025-12-04 10:01:04 [manheim.gb] INFO: Scrape type for 1191100: 0
2025-12-04 10:01:04 [manheim.gb] INFO: Found listing with ID: 1195824
2025-12-04 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271195824%27 HTTP/1.1" 200 None
2025-12-04 10:01:04 [manheim.gb] INFO: Scrape type for 1195824: 0
2025-12-04 10:01:04 [manheim.gb] INFO: Found listing with ID: 124569
2025-12-04 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27124569%27 HTTP/1.1" 200 None
2025-12-04 10:01:04 [manheim.gb] INFO: Scrape type for 124569: 0
2025-12-04 10:01:04 [manheim.gb] INFO: Found listing with ID: 1257174
2025-12-04 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271257174%27 HTTP/1.1" 200 None
2025-12-04 10:01:04 [manheim.gb] INFO: Scrape type for 1257174: 0
2025-12-04 10:01:04 [manheim.gb] INFO: Found listing with ID: 1271730
2025-12-04 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271271730%27 HTTP/1.1" 200 None
2025-12-04 10:01:04 [manheim.gb] INFO: Scrape type for 1271730: 0
2025-12-04 10:01:04 [manheim.gb] INFO: Found listing with ID: 1281726
2025-12-04 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271281726%27 HTTP/1.1" 200 None
2025-12-04 10:01:04 [manheim.gb] INFO: Scrape type for 1281726: 0
2025-12-04 10:01:04 [manheim.gb] INFO: Found listing with ID: 1297328
2025-12-04 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271297328%27 HTTP/1.1" 200 None
2025-12-04 10:01:04 [manheim.gb] INFO: Scrape type for 1297328: 0
2025-12-04 10:01:04 [manheim.gb] INFO: Found listing with ID: 1306828
2025-12-04 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271306828%27 HTTP/1.1" 200 None
2025-12-04 10:01:04 [manheim.gb] INFO: Scrape type for 1306828: 0
2025-12-04 10:01:04 [manheim.gb] INFO: Found listing with ID: 1314291
2025-12-04 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271314291%27 HTTP/1.1" 200 None
2025-12-04 10:01:04 [manheim.gb] INFO: Scrape type for 1314291: 0
2025-12-04 10:01:04 [manheim.gb] INFO: Found listing with ID: 1319653
2025-12-04 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271319653%27 HTTP/1.1" 200 None
2025-12-04 10:01:04 [manheim.gb] INFO: Scrape type for 1319653: 0
2025-12-04 10:01:04 [manheim.gb] INFO: Found listing with ID: 1376686
2025-12-04 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271376686%27 HTTP/1.1" 200 None
2025-12-04 10:01:04 [manheim.gb] INFO: Scrape type for 1376686: 0
2025-12-04 10:01:04 [manheim.gb] INFO: Found listing with ID: 1403363
2025-12-04 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271403363%27 HTTP/1.1" 200 None
2025-12-04 10:01:04 [manheim.gb] INFO: Scrape type for 1403363: 0
2025-12-04 10:01:04 [manheim.gb] INFO: Found listing with ID: 1405448
2025-12-04 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271405448%27 HTTP/1.1" 200 None
2025-12-04 10:01:04 [manheim.gb] INFO: Scrape type for 1405448: 0
2025-12-04 10:01:04 [manheim.gb] INFO: Found listing with ID: 1414418
2025-12-04 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271414418%27 HTTP/1.1" 200 None
2025-12-04 10:01:04 [manheim.gb] INFO: Scrape type for 1414418: 1
2025-12-04 10:01:04 [manheim.gb] INFO: Found listing with ID: 1418917
2025-12-04 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271418917%27 HTTP/1.1" 200 None
2025-12-04 10:01:04 [manheim.gb] INFO: Scrape type for 1418917: 0
2025-12-04 10:01:04 [manheim.gb] INFO: Found listing with ID: 1430865
2025-12-04 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271430865%27 HTTP/1.1" 200 None
2025-12-04 10:01:04 [manheim.gb] INFO: Scrape type for 1430865: 1
2025-12-04 10:01:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 10:01:04 [manheim.gb] INFO: Found listing with ID: 1432512
2025-12-04 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271432512%27 HTTP/1.1" 200 None
2025-12-04 10:01:04 [manheim.gb] INFO: Scrape type for 1432512: 0
2025-12-04 10:01:04 [manheim.gb] INFO: Found listing with ID: 1473959
2025-12-04 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271473959%27 HTTP/1.1" 200 None
2025-12-04 10:01:04 [manheim.gb] INFO: Scrape type for 1473959: 0
2025-12-04 10:01:04 [manheim.gb] INFO: Found listing with ID: 1479833
2025-12-04 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271479833%27 HTTP/1.1" 200 None
2025-12-04 10:01:05 [manheim.gb] INFO: Scrape type for 1479833: 0
2025-12-04 10:01:05 [manheim.gb] INFO: Found listing with ID: 1484153
2025-12-04 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271484153%27 HTTP/1.1" 200 None
2025-12-04 10:01:05 [manheim.gb] INFO: Scrape type for 1484153: 0
2025-12-04 10:01:05 [manheim.gb] INFO: Found listing with ID: 1490428
2025-12-04 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271490428%27 HTTP/1.1" 200 None
2025-12-04 10:01:05 [manheim.gb] INFO: Scrape type for 1490428: 0
2025-12-04 10:01:05 [manheim.gb] INFO: Found listing with ID: 1501704
2025-12-04 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271501704%27 HTTP/1.1" 200 None
2025-12-04 10:01:05 [manheim.gb] INFO: Scrape type for 1501704: 0
2025-12-04 10:01:05 [manheim.gb] INFO: Found listing with ID: 1506482
2025-12-04 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271506482%27 HTTP/1.1" 200 None
2025-12-04 10:01:05 [manheim.gb] INFO: Scrape type for 1506482: 1
2025-12-04 10:01:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 10:01:05 [manheim.gb] INFO: Found listing with ID: 1535266
2025-12-04 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271535266%27 HTTP/1.1" 200 None
2025-12-04 10:01:05 [manheim.gb] INFO: Scrape type for 1535266: 0
2025-12-04 10:01:05 [manheim.gb] INFO: Found listing with ID: 1541191
2025-12-04 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271541191%27 HTTP/1.1" 200 None
2025-12-04 10:01:05 [manheim.gb] INFO: Scrape type for 1541191: 0
2025-12-04 10:01:05 [manheim.gb] INFO: Found listing with ID: 1546758
2025-12-04 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271546758%27 HTTP/1.1" 200 None
2025-12-04 10:01:05 [manheim.gb] INFO: Scrape type for 1546758: 0
2025-12-04 10:01:05 [manheim.gb] INFO: Found listing with ID: 1563459
2025-12-04 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271563459%27 HTTP/1.1" 200 None
2025-12-04 10:01:05 [manheim.gb] INFO: Scrape type for 1563459: 0
2025-12-04 10:01:05 [manheim.gb] INFO: Found listing with ID: 1564179
2025-12-04 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271564179%27 HTTP/1.1" 200 None
2025-12-04 10:01:05 [manheim.gb] INFO: Scrape type for 1564179: 1
2025-12-04 10:01:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 10:01:05 [manheim.gb] INFO: Found listing with ID: 1580164
2025-12-04 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271580164%27 HTTP/1.1" 200 None
2025-12-04 10:01:05 [manheim.gb] INFO: Scrape type for 1580164: 0
2025-12-04 10:01:05 [manheim.gb] INFO: Found listing with ID: 1701386
2025-12-04 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271701386%27 HTTP/1.1" 200 None
2025-12-04 10:01:05 [manheim.gb] INFO: Scrape type for 1701386: 0
2025-12-04 10:01:05 [manheim.gb] INFO: Found listing with ID: 1714274
2025-12-04 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271714274%27 HTTP/1.1" 200 None
2025-12-04 10:01:05 [manheim.gb] INFO: Scrape type for 1714274: 0
2025-12-04 10:01:05 [manheim.gb] INFO: Found listing with ID: 1753030
2025-12-04 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271753030%27 HTTP/1.1" 200 None
2025-12-04 10:01:05 [manheim.gb] INFO: Scrape type for 1753030: 0
2025-12-04 10:01:05 [manheim.gb] INFO: Found listing with ID: 1761741
2025-12-04 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271761741%27 HTTP/1.1" 200 None
2025-12-04 10:01:05 [manheim.gb] INFO: Scrape type for 1761741: 1
2025-12-04 10:01:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 10:01:05 [manheim.gb] INFO: Found listing with ID: 1783769
2025-12-04 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271783769%27 HTTP/1.1" 200 None
2025-12-04 10:01:05 [manheim.gb] INFO: Scrape type for 1783769: 0
2025-12-04 10:01:05 [manheim.gb] INFO: Found listing with ID: 1787313
2025-12-04 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271787313%27 HTTP/1.1" 200 None
2025-12-04 10:01:05 [manheim.gb] INFO: Scrape type for 1787313: 0
2025-12-04 10:01:05 [manheim.gb] INFO: Found listing with ID: 1798612
2025-12-04 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271798612%27 HTTP/1.1" 200 None
2025-12-04 10:01:05 [manheim.gb] INFO: Scrape type for 1798612: 0
2025-12-04 10:01:05 [manheim.gb] INFO: Found listing with ID: 1815539
2025-12-04 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271815539%27 HTTP/1.1" 200 None
2025-12-04 10:01:05 [manheim.gb] INFO: Scrape type for 1815539: 0
2025-12-04 10:01:05 [manheim.gb] INFO: Found listing with ID: 1835329
2025-12-04 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271835329%27 HTTP/1.1" 200 None
2025-12-04 10:01:05 [manheim.gb] INFO: Scrape type for 1835329: 0
2025-12-04 10:01:05 [manheim.gb] INFO: Found listing with ID: 1847472
2025-12-04 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271847472%27 HTTP/1.1" 200 None
2025-12-04 10:01:05 [manheim.gb] INFO: Scrape type for 1847472: 0
2025-12-04 10:01:05 [manheim.gb] INFO: Found listing with ID: 1856076
2025-12-04 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271856076%27 HTTP/1.1" 200 None
2025-12-04 10:01:05 [manheim.gb] INFO: Scrape type for 1856076: 0
2025-12-04 10:01:05 [manheim.gb] INFO: Found listing with ID: 1856565
2025-12-04 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271856565%27 HTTP/1.1" 200 None
2025-12-04 10:01:05 [manheim.gb] INFO: Scrape type for 1856565: 0
2025-12-04 10:01:05 [manheim.gb] INFO: Found listing with ID: 1859294
2025-12-04 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271859294%27 HTTP/1.1" 200 None
2025-12-04 10:01:05 [manheim.gb] INFO: Scrape type for 1859294: 0
2025-12-04 10:01:05 [manheim.gb] INFO: Found listing with ID: 186738
2025-12-04 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27186738%27 HTTP/1.1" 200 None
2025-12-04 10:01:05 [manheim.gb] INFO: Scrape type for 186738: 0
2025-12-04 10:01:05 [manheim.gb] INFO: Found listing with ID: 1877473
2025-12-04 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271877473%27 HTTP/1.1" 200 None
2025-12-04 10:01:05 [manheim.gb] INFO: Scrape type for 1877473: 0
2025-12-04 10:01:05 [manheim.gb] INFO: Found listing with ID: 1912686
2025-12-04 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271912686%27 HTTP/1.1" 200 None
2025-12-04 10:01:05 [manheim.gb] INFO: Scrape type for 1912686: 0
2025-12-04 10:01:05 [manheim.gb] INFO: Found listing with ID: 1950952
2025-12-04 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271950952%27 HTTP/1.1" 200 None
2025-12-04 10:01:05 [manheim.gb] INFO: Scrape type for 1950952: 0
2025-12-04 10:01:05 [manheim.gb] INFO: Found listing with ID: 1962040
2025-12-04 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271962040%27 HTTP/1.1" 200 None
2025-12-04 10:01:05 [manheim.gb] INFO: Scrape type for 1962040: 0
2025-12-04 10:01:05 [manheim.gb] INFO: Found listing with ID: 1966868
2025-12-04 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271966868%27 HTTP/1.1" 200 None
2025-12-04 10:01:05 [manheim.gb] INFO: Scrape type for 1966868: 1
2025-12-04 10:01:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 10:01:05 [manheim.gb] INFO: Found listing with ID: 1976170
2025-12-04 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271976170%27 HTTP/1.1" 200 None
2025-12-04 10:01:05 [manheim.gb] INFO: Scrape type for 1976170: 0
2025-12-04 10:01:05 [manheim.gb] INFO: Found listing with ID: 1984275
2025-12-04 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271984275%27 HTTP/1.1" 200 None
2025-12-04 10:01:05 [manheim.gb] INFO: Scrape type for 1984275: 0
2025-12-04 10:01:05 [manheim.gb] INFO: Found listing with ID: 1995165
2025-12-04 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271995165%27 HTTP/1.1" 200 None
2025-12-04 10:01:05 [manheim.gb] INFO: Scrape type for 1995165: 0
2025-12-04 10:01:05 [manheim.gb] INFO: Found listing with ID: 2014140
2025-12-04 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272014140%27 HTTP/1.1" 200 None
2025-12-04 10:01:05 [manheim.gb] INFO: Scrape type for 2014140: 0
2025-12-04 10:01:05 [manheim.gb] INFO: Found listing with ID: 2022887
2025-12-04 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272022887%27 HTTP/1.1" 200 None
2025-12-04 10:01:05 [manheim.gb] INFO: Scrape type for 2022887: 0
2025-12-04 10:01:05 [manheim.gb] INFO: Found listing with ID: 2057516
2025-12-04 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272057516%27 HTTP/1.1" 200 None
2025-12-04 10:01:05 [manheim.gb] INFO: Scrape type for 2057516: 0
2025-12-04 10:01:05 [manheim.gb] INFO: Found listing with ID: 2058572
2025-12-04 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272058572%27 HTTP/1.1" 200 None
2025-12-04 10:01:05 [manheim.gb] INFO: Scrape type for 2058572: 0
2025-12-04 10:01:05 [manheim.gb] INFO: Found listing with ID: 2063938
2025-12-04 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272063938%27 HTTP/1.1" 200 None
2025-12-04 10:01:05 [manheim.gb] INFO: Scrape type for 2063938: 0
2025-12-04 10:01:05 [manheim.gb] INFO: Found listing with ID: 2075642
2025-12-04 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272075642%27 HTTP/1.1" 200 None
2025-12-04 10:01:05 [manheim.gb] INFO: Scrape type for 2075642: 2
2025-12-04 10:01:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 10:01:05 [manheim.gb] INFO: Found listing with ID: 2091777
2025-12-04 10:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272091777%27 HTTP/1.1" 200 None
2025-12-04 10:01:06 [manheim.gb] INFO: Scrape type for 2091777: 0
2025-12-04 10:01:06 [manheim.gb] INFO: Found listing with ID: 2093385
2025-12-04 10:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272093385%27 HTTP/1.1" 200 None
2025-12-04 10:01:06 [manheim.gb] INFO: Scrape type for 2093385: 0
2025-12-04 10:01:06 [manheim.gb] INFO: Found listing with ID: 2143943
2025-12-04 10:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272143943%27 HTTP/1.1" 200 None
2025-12-04 10:01:06 [manheim.gb] INFO: Scrape type for 2143943: 0
2025-12-04 10:01:06 [manheim.gb] INFO: Found listing with ID: 2176421
2025-12-04 10:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272176421%27 HTTP/1.1" 200 None
2025-12-04 10:01:06 [manheim.gb] INFO: Scrape type for 2176421: 0
2025-12-04 10:01:06 [manheim.gb] INFO: Found listing with ID: 2186514
2025-12-04 10:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272186514%27 HTTP/1.1" 200 None
2025-12-04 10:01:06 [manheim.gb] INFO: Scrape type for 2186514: 0
2025-12-04 10:01:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 10:01:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 10:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/refine> (referer: https://www.manheim.co.uk/search) ['zyte-api']
2025-12-04 10:01:09 [manheim.gb] INFO: Found listing with ID: 2213672
2025-12-04 10:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272213672%27 HTTP/1.1" 200 None
2025-12-04 10:01:09 [manheim.gb] INFO: Scrape type for 2213672: 0
2025-12-04 10:01:09 [manheim.gb] INFO: Found listing with ID: 2237239
2025-12-04 10:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272237239%27 HTTP/1.1" 200 None
2025-12-04 10:01:09 [manheim.gb] INFO: Scrape type for 2237239: 0
2025-12-04 10:01:09 [manheim.gb] INFO: Found listing with ID: 2247450
2025-12-04 10:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272247450%27 HTTP/1.1" 200 None
2025-12-04 10:01:09 [manheim.gb] INFO: Scrape type for 2247450: 1
2025-12-04 10:01:09 [manheim.gb] INFO: Found listing with ID: 2255783
2025-12-04 10:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272255783%27 HTTP/1.1" 200 None
2025-12-04 10:01:09 [manheim.gb] INFO: Scrape type for 2255783: 0
2025-12-04 10:01:09 [manheim.gb] INFO: Found listing with ID: 2262431
2025-12-04 10:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272262431%27 HTTP/1.1" 200 None
2025-12-04 10:01:09 [manheim.gb] INFO: Scrape type for 2262431: 0
2025-12-04 10:01:09 [manheim.gb] INFO: Found listing with ID: 2265358
2025-12-04 10:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272265358%27 HTTP/1.1" 200 None
2025-12-04 10:01:09 [manheim.gb] INFO: Scrape type for 2265358: 1
2025-12-04 10:01:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 10:01:09 [manheim.gb] INFO: Found listing with ID: 2286249
2025-12-04 10:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272286249%27 HTTP/1.1" 200 None
2025-12-04 10:01:09 [manheim.gb] INFO: Scrape type for 2286249: 0
2025-12-04 10:01:09 [manheim.gb] INFO: Found listing with ID: 2292492
2025-12-04 10:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272292492%27 HTTP/1.1" 200 None
2025-12-04 10:01:09 [manheim.gb] INFO: Scrape type for 2292492: 0
2025-12-04 10:01:09 [manheim.gb] INFO: Found listing with ID: 2292927
2025-12-04 10:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272292927%27 HTTP/1.1" 200 None
2025-12-04 10:01:09 [manheim.gb] INFO: Scrape type for 2292927: 0
2025-12-04 10:01:09 [manheim.gb] INFO: Found listing with ID: 2301535
2025-12-04 10:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272301535%27 HTTP/1.1" 200 None
2025-12-04 10:01:09 [manheim.gb] INFO: Scrape type for 2301535: 0
2025-12-04 10:01:09 [manheim.gb] INFO: Found listing with ID: 2303707
2025-12-04 10:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272303707%27 HTTP/1.1" 200 None
2025-12-04 10:01:09 [manheim.gb] INFO: Scrape type for 2303707: 0
2025-12-04 10:01:09 [manheim.gb] INFO: Found listing with ID: 2316345
2025-12-04 10:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272316345%27 HTTP/1.1" 200 None
2025-12-04 10:01:09 [manheim.gb] INFO: Scrape type for 2316345: 0
2025-12-04 10:01:09 [manheim.gb] INFO: Found listing with ID: 2326281
2025-12-04 10:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272326281%27 HTTP/1.1" 200 None
2025-12-04 10:01:09 [manheim.gb] INFO: Scrape type for 2326281: 0
2025-12-04 10:01:09 [manheim.gb] INFO: Found listing with ID: 233754
2025-12-04 10:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27233754%27 HTTP/1.1" 200 None
2025-12-04 10:01:09 [manheim.gb] INFO: Scrape type for 233754: 1
2025-12-04 10:01:09 [manheim.gb] INFO: Found listing with ID: 2354571
2025-12-04 10:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272354571%27 HTTP/1.1" 200 None
2025-12-04 10:01:09 [manheim.gb] INFO: Scrape type for 2354571: 0
2025-12-04 10:01:09 [manheim.gb] INFO: Found listing with ID: 2359941
2025-12-04 10:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272359941%27 HTTP/1.1" 200 None
2025-12-04 10:01:09 [manheim.gb] INFO: Scrape type for 2359941: 0
2025-12-04 10:01:09 [manheim.gb] INFO: Found listing with ID: 2365471
2025-12-04 10:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272365471%27 HTTP/1.1" 200 None
2025-12-04 10:01:09 [manheim.gb] INFO: Scrape type for 2365471: 0
2025-12-04 10:01:09 [manheim.gb] INFO: Found listing with ID: 2374569
2025-12-04 10:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272374569%27 HTTP/1.1" 200 None
2025-12-04 10:01:09 [manheim.gb] INFO: Scrape type for 2374569: 0
2025-12-04 10:01:09 [manheim.gb] INFO: Found listing with ID: 2395632
2025-12-04 10:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272395632%27 HTTP/1.1" 200 None
2025-12-04 10:01:09 [manheim.gb] INFO: Scrape type for 2395632: 0
2025-12-04 10:01:09 [manheim.gb] INFO: Found listing with ID: 2407950
2025-12-04 10:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272407950%27 HTTP/1.1" 200 None
2025-12-04 10:01:09 [manheim.gb] INFO: Scrape type for 2407950: 0
2025-12-04 10:01:09 [manheim.gb] INFO: Found listing with ID: 2416699
2025-12-04 10:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272416699%27 HTTP/1.1" 200 None
2025-12-04 10:01:09 [manheim.gb] INFO: Scrape type for 2416699: 0
2025-12-04 10:01:09 [manheim.gb] INFO: Found listing with ID: 2437613
2025-12-04 10:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272437613%27 HTTP/1.1" 200 None
2025-12-04 10:01:09 [manheim.gb] INFO: Scrape type for 2437613: 0
2025-12-04 10:01:09 [manheim.gb] INFO: Found listing with ID: 2443557
2025-12-04 10:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272443557%27 HTTP/1.1" 200 None
2025-12-04 10:01:09 [manheim.gb] INFO: Scrape type for 2443557: 0
2025-12-04 10:01:09 [manheim.gb] INFO: Found listing with ID: 2443996
2025-12-04 10:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272443996%27 HTTP/1.1" 200 None
2025-12-04 10:01:09 [manheim.gb] INFO: Scrape type for 2443996: 0
2025-12-04 10:01:09 [manheim.gb] INFO: Found listing with ID: 2456004
2025-12-04 10:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272456004%27 HTTP/1.1" 200 None
2025-12-04 10:01:09 [manheim.gb] INFO: Scrape type for 2456004: 0
2025-12-04 10:01:09 [manheim.gb] INFO: Found listing with ID: 2458076
2025-12-04 10:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272458076%27 HTTP/1.1" 200 None
2025-12-04 10:01:09 [manheim.gb] INFO: Scrape type for 2458076: 0
2025-12-04 10:01:09 [manheim.gb] INFO: Found listing with ID: 2461241
2025-12-04 10:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272461241%27 HTTP/1.1" 200 None
2025-12-04 10:01:09 [manheim.gb] INFO: Scrape type for 2461241: 0
2025-12-04 10:01:09 [manheim.gb] INFO: Found listing with ID: 2492073
2025-12-04 10:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272492073%27 HTTP/1.1" 200 None
2025-12-04 10:01:09 [manheim.gb] INFO: Scrape type for 2492073: 0
2025-12-04 10:01:09 [manheim.gb] INFO: Found listing with ID: 2512673
2025-12-04 10:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272512673%27 HTTP/1.1" 200 None
2025-12-04 10:01:09 [manheim.gb] INFO: Scrape type for 2512673: 0
2025-12-04 10:01:09 [manheim.gb] INFO: Found listing with ID: 2528107
2025-12-04 10:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272528107%27 HTTP/1.1" 200 None
2025-12-04 10:01:09 [manheim.gb] INFO: Scrape type for 2528107: 0
2025-12-04 10:01:09 [manheim.gb] INFO: Found listing with ID: 2528639
2025-12-04 10:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272528639%27 HTTP/1.1" 200 None
2025-12-04 10:01:09 [manheim.gb] INFO: Scrape type for 2528639: 0
2025-12-04 10:01:09 [manheim.gb] INFO: Found listing with ID: 2542025
2025-12-04 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272542025%27 HTTP/1.1" 200 None
2025-12-04 10:01:10 [manheim.gb] INFO: Scrape type for 2542025: 0
2025-12-04 10:01:10 [manheim.gb] INFO: Found listing with ID: 255681
2025-12-04 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27255681%27 HTTP/1.1" 200 None
2025-12-04 10:01:10 [manheim.gb] INFO: Scrape type for 255681: 0
2025-12-04 10:01:10 [manheim.gb] INFO: Found listing with ID: 2557325
2025-12-04 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272557325%27 HTTP/1.1" 200 None
2025-12-04 10:01:10 [manheim.gb] INFO: Scrape type for 2557325: 0
2025-12-04 10:01:10 [manheim.gb] INFO: Found listing with ID: 2562472
2025-12-04 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272562472%27 HTTP/1.1" 200 None
2025-12-04 10:01:10 [manheim.gb] INFO: Scrape type for 2562472: 0
2025-12-04 10:01:10 [manheim.gb] INFO: Found listing with ID: 2577653
2025-12-04 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272577653%27 HTTP/1.1" 200 None
2025-12-04 10:01:10 [manheim.gb] INFO: Scrape type for 2577653: 0
2025-12-04 10:01:10 [manheim.gb] INFO: Found listing with ID: 2589156
2025-12-04 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272589156%27 HTTP/1.1" 200 None
2025-12-04 10:01:10 [manheim.gb] INFO: Scrape type for 2589156: 0
2025-12-04 10:01:10 [manheim.gb] INFO: Found listing with ID: 2590049
2025-12-04 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272590049%27 HTTP/1.1" 200 None
2025-12-04 10:01:10 [manheim.gb] INFO: Scrape type for 2590049: 0
2025-12-04 10:01:10 [manheim.gb] INFO: Found listing with ID: 2606673
2025-12-04 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272606673%27 HTTP/1.1" 200 None
2025-12-04 10:01:10 [manheim.gb] INFO: Scrape type for 2606673: 1
2025-12-04 10:01:10 [manheim.gb] INFO: Found listing with ID: 2609231
2025-12-04 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272609231%27 HTTP/1.1" 200 None
2025-12-04 10:01:10 [manheim.gb] INFO: Scrape type for 2609231: 0
2025-12-04 10:01:10 [manheim.gb] INFO: Found listing with ID: 2616439
2025-12-04 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272616439%27 HTTP/1.1" 200 None
2025-12-04 10:01:10 [manheim.gb] INFO: Scrape type for 2616439: 0
2025-12-04 10:01:10 [manheim.gb] INFO: Found listing with ID: 2628170
2025-12-04 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272628170%27 HTTP/1.1" 200 None
2025-12-04 10:01:10 [manheim.gb] INFO: Scrape type for 2628170: 0
2025-12-04 10:01:10 [manheim.gb] INFO: Found listing with ID: 2654910
2025-12-04 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272654910%27 HTTP/1.1" 200 None
2025-12-04 10:01:10 [manheim.gb] INFO: Scrape type for 2654910: 0
2025-12-04 10:01:10 [manheim.gb] INFO: Found listing with ID: 2664010
2025-12-04 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272664010%27 HTTP/1.1" 200 None
2025-12-04 10:01:10 [manheim.gb] INFO: Scrape type for 2664010: 0
2025-12-04 10:01:10 [manheim.gb] INFO: Found listing with ID: 2667513
2025-12-04 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272667513%27 HTTP/1.1" 200 None
2025-12-04 10:01:10 [manheim.gb] INFO: Scrape type for 2667513: 0
2025-12-04 10:01:10 [manheim.gb] INFO: Found listing with ID: 2688065
2025-12-04 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272688065%27 HTTP/1.1" 200 None
2025-12-04 10:01:10 [manheim.gb] INFO: Scrape type for 2688065: 0
2025-12-04 10:01:10 [manheim.gb] INFO: Found listing with ID: 2699424
2025-12-04 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272699424%27 HTTP/1.1" 200 None
2025-12-04 10:01:10 [manheim.gb] INFO: Scrape type for 2699424: 0
2025-12-04 10:01:10 [manheim.gb] INFO: Found listing with ID: 269980
2025-12-04 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27269980%27 HTTP/1.1" 200 None
2025-12-04 10:01:10 [manheim.gb] INFO: Scrape type for 269980: 0
2025-12-04 10:01:10 [manheim.gb] INFO: Found listing with ID: 2727315
2025-12-04 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272727315%27 HTTP/1.1" 200 None
2025-12-04 10:01:10 [manheim.gb] INFO: Scrape type for 2727315: 0
2025-12-04 10:01:10 [manheim.gb] INFO: Found listing with ID: 2733772
2025-12-04 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272733772%27 HTTP/1.1" 200 None
2025-12-04 10:01:10 [manheim.gb] INFO: Scrape type for 2733772: 0
2025-12-04 10:01:10 [manheim.gb] INFO: Found listing with ID: 2744515
2025-12-04 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272744515%27 HTTP/1.1" 200 None
2025-12-04 10:01:10 [manheim.gb] INFO: Scrape type for 2744515: 0
2025-12-04 10:01:10 [manheim.gb] INFO: Found listing with ID: 2746923
2025-12-04 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272746923%27 HTTP/1.1" 200 None
2025-12-04 10:01:10 [manheim.gb] INFO: Scrape type for 2746923: 0
2025-12-04 10:01:10 [manheim.gb] INFO: Found listing with ID: 2752960
2025-12-04 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272752960%27 HTTP/1.1" 200 None
2025-12-04 10:01:10 [manheim.gb] INFO: Scrape type for 2752960: 0
2025-12-04 10:01:10 [manheim.gb] INFO: Found listing with ID: 2765368
2025-12-04 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272765368%27 HTTP/1.1" 200 None
2025-12-04 10:01:10 [manheim.gb] INFO: Scrape type for 2765368: 0
2025-12-04 10:01:10 [manheim.gb] INFO: Found listing with ID: 2765752
2025-12-04 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272765752%27 HTTP/1.1" 200 None
2025-12-04 10:01:10 [manheim.gb] INFO: Scrape type for 2765752: 0
2025-12-04 10:01:10 [manheim.gb] INFO: Found listing with ID: 2778685
2025-12-04 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272778685%27 HTTP/1.1" 200 None
2025-12-04 10:01:10 [manheim.gb] INFO: Scrape type for 2778685: 0
2025-12-04 10:01:10 [manheim.gb] INFO: Found listing with ID: 2782744
2025-12-04 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272782744%27 HTTP/1.1" 200 None
2025-12-04 10:01:10 [manheim.gb] INFO: Scrape type for 2782744: 0
2025-12-04 10:01:10 [manheim.gb] INFO: Found listing with ID: 2809184
2025-12-04 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272809184%27 HTTP/1.1" 200 None
2025-12-04 10:01:10 [manheim.gb] INFO: Scrape type for 2809184: 0
2025-12-04 10:01:10 [manheim.gb] INFO: Found listing with ID: 2817812
2025-12-04 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272817812%27 HTTP/1.1" 200 None
2025-12-04 10:01:10 [manheim.gb] INFO: Scrape type for 2817812: 0
2025-12-04 10:01:10 [manheim.gb] INFO: Found listing with ID: 2830703
2025-12-04 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272830703%27 HTTP/1.1" 200 None
2025-12-04 10:01:10 [manheim.gb] INFO: Scrape type for 2830703: 0
2025-12-04 10:01:10 [manheim.gb] INFO: Found listing with ID: 2886723
2025-12-04 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272886723%27 HTTP/1.1" 200 None
2025-12-04 10:01:10 [manheim.gb] INFO: Scrape type for 2886723: 0
2025-12-04 10:01:10 [manheim.gb] INFO: Found listing with ID: 2891297
2025-12-04 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272891297%27 HTTP/1.1" 200 None
2025-12-04 10:01:10 [manheim.gb] INFO: Scrape type for 2891297: 0
2025-12-04 10:01:10 [manheim.gb] INFO: Found listing with ID: 2893691
2025-12-04 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272893691%27 HTTP/1.1" 200 None
2025-12-04 10:01:10 [manheim.gb] INFO: Scrape type for 2893691: 0
2025-12-04 10:01:10 [manheim.gb] INFO: Found listing with ID: 2896151
2025-12-04 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272896151%27 HTTP/1.1" 200 None
2025-12-04 10:01:10 [manheim.gb] INFO: Scrape type for 2896151: 0
2025-12-04 10:01:10 [manheim.gb] INFO: Found listing with ID: 2907623
2025-12-04 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272907623%27 HTTP/1.1" 200 None
2025-12-04 10:01:10 [manheim.gb] INFO: Scrape type for 2907623: 0
2025-12-04 10:01:10 [manheim.gb] INFO: Found listing with ID: 2933109
2025-12-04 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272933109%27 HTTP/1.1" 200 None
2025-12-04 10:01:10 [manheim.gb] INFO: Scrape type for 2933109: 0
2025-12-04 10:01:10 [manheim.gb] INFO: Found listing with ID: 2936605
2025-12-04 10:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272936605%27 HTTP/1.1" 200 None
2025-12-04 10:01:11 [manheim.gb] INFO: Scrape type for 2936605: 0
2025-12-04 10:01:11 [manheim.gb] INFO: Found listing with ID: 2936956
2025-12-04 10:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272936956%27 HTTP/1.1" 200 None
2025-12-04 10:01:11 [manheim.gb] INFO: Scrape type for 2936956: 0
2025-12-04 10:01:11 [manheim.gb] INFO: Found listing with ID: 2939815
2025-12-04 10:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272939815%27 HTTP/1.1" 200 None
2025-12-04 10:01:11 [manheim.gb] INFO: Scrape type for 2939815: 0
2025-12-04 10:01:11 [manheim.gb] INFO: Found listing with ID: 2944079
2025-12-04 10:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272944079%27 HTTP/1.1" 200 None
2025-12-04 10:01:11 [manheim.gb] INFO: Scrape type for 2944079: 0
2025-12-04 10:01:11 [manheim.gb] INFO: Found listing with ID: 2948457
2025-12-04 10:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272948457%27 HTTP/1.1" 200 None
2025-12-04 10:01:11 [manheim.gb] INFO: Scrape type for 2948457: 0
2025-12-04 10:01:11 [manheim.gb] INFO: Found listing with ID: 2956148
2025-12-04 10:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272956148%27 HTTP/1.1" 200 None
2025-12-04 10:01:11 [manheim.gb] INFO: Scrape type for 2956148: 0
2025-12-04 10:01:11 [manheim.gb] INFO: Found listing with ID: 2968035
2025-12-04 10:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272968035%27 HTTP/1.1" 200 None
2025-12-04 10:01:11 [manheim.gb] INFO: Scrape type for 2968035: 0
2025-12-04 10:01:25 [scrapy.extensions.logstats] INFO: Crawled 3 pages (at 3 pages/min), scraped 0 items (at 0 items/min)
2025-12-04 10:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=1414418&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231414418&indx=35> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 10:01:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 10:01:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51536adf-85f9-5173-8b23-b3de10fde1e6 with identifier: 1414418
2025-12-04 10:01:29 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 51536adf-85f9-5173-8b23-b3de10fde1e6
2025-12-04 10:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0001414418-01988999-002.pdf> (referer: None)
2025-12-04 10:01:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:01:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc7e6d50>
2025-12-04 10:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:01:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51536adf-85f9-5173-8b23-b3de10fde1e6/51536adf-85f9-5173-8b23-b3de10fde1e6_expert_report_file_b41b1084-45e1-49d3-bff2-5ca3330f0123.pdf HTTP/1.1" 201 0
2025-12-04 10:01:31 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 51536adf-85f9-5173-8b23-b3de10fde1e6
2025-12-04 10:01:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 51536adf-85f9-5173-8b23-b3de10fde1e6, skipping ID generation
2025-12-04 10:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 51536adf-85f9-5173-8b23-b3de10fde1e6
2025-12-04 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7e176b82-36f1-4b17-9f6a-88603b02eac6_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7e176b82-36f1-4b17-9f6a-88603b02eac6_ext_7.jpg not downloaded yet
2025-12-04 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7e176b82-36f1-4b17-9f6a-88603b02eac6_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7e176b82-36f1-4b17-9f6a-88603b02eac6_ext_7.jpg not downloaded yet
2025-12-04 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7e176b82-36f1-4b17-9f6a-88603b02eac6_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7e176b82-36f1-4b17-9f6a-88603b02eac6_ext_6.jpg not downloaded yet
2025-12-04 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7e176b82-36f1-4b17-9f6a-88603b02eac6_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7e176b82-36f1-4b17-9f6a-88603b02eac6_ext_1.jpg not downloaded yet
2025-12-04 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7e176b82-36f1-4b17-9f6a-88603b02eac6_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7e176b82-36f1-4b17-9f6a-88603b02eac6_5.jpg not downloaded yet
2025-12-04 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7e176b82-36f1-4b17-9f6a-88603b02eac6_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7e176b82-36f1-4b17-9f6a-88603b02eac6_4.jpg not downloaded yet
2025-12-04 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7e176b82-36f1-4b17-9f6a-88603b02eac6_11.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7e176b82-36f1-4b17-9f6a-88603b02eac6_11.jpg not downloaded yet
2025-12-04 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7e176b82-36f1-4b17-9f6a-88603b02eac6_10.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7e176b82-36f1-4b17-9f6a-88603b02eac6_10.jpg not downloaded yet
2025-12-04 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7e176b82-36f1-4b17-9f6a-88603b02eac6_9.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7e176b82-36f1-4b17-9f6a-88603b02eac6_9.jpg not downloaded yet
2025-12-04 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7e176b82-36f1-4b17-9f6a-88603b02eac6_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7e176b82-36f1-4b17-9f6a-88603b02eac6_ext_2.jpg not downloaded yet
2025-12-04 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7e176b82-36f1-4b17-9f6a-88603b02eac6_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7e176b82-36f1-4b17-9f6a-88603b02eac6_ext_5.jpg not downloaded yet
2025-12-04 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7e176b82-36f1-4b17-9f6a-88603b02eac6_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7e176b82-36f1-4b17-9f6a-88603b02eac6_ext_3.jpg not downloaded yet
2025-12-04 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7e176b82-36f1-4b17-9f6a-88603b02eac6_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7e176b82-36f1-4b17-9f6a-88603b02eac6_ext_4.jpg not downloaded yet
2025-12-04 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1414418-4007407-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1414418-4007407-13.jpg not downloaded yet
2025-12-04 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1414418-4007407-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1414418-4007407-1000.jpg not downloaded yet
2025-12-04 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1414418-4007407-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1414418-4007407-1001.jpg not downloaded yet
2025-12-04 10:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7e176b82-36f1-4b17-9f6a-88603b02eac6_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001414418-01988999-002.pdf)
2025-12-04 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1414418-4007407-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1414418-4007407-1002.jpg not downloaded yet
2025-12-04 10:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7e176b82-36f1-4b17-9f6a-88603b02eac6_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001414418-01988999-002.pdf)
2025-12-04 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1414418-4007407-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1414418-4007407-1003.jpg not downloaded yet
2025-12-04 10:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7e176b82-36f1-4b17-9f6a-88603b02eac6_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001414418-01988999-002.pdf)
2025-12-04 10:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7e176b82-36f1-4b17-9f6a-88603b02eac6_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001414418-01988999-002.pdf)
2025-12-04 10:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7e176b82-36f1-4b17-9f6a-88603b02eac6_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001414418-01988999-002.pdf)
2025-12-04 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1414418-4007407-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1414418-4007407-1004.jpg not downloaded yet
2025-12-04 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1414418-4007407-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1414418-4007407-1005.jpg not downloaded yet
2025-12-04 10:01:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:01:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccc5dad0>
2025-12-04 10:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:01:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:01:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51536adf-85f9-5173-8b23-b3de10fde1e6/51536adf-85f9-5173-8b23-b3de10fde1e6_image_0.jpg HTTP/1.1" 201 0
2025-12-04 10:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7e176b82-36f1-4b17-9f6a-88603b02eac6_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7e176b82-36f1-4b17-9f6a-88603b02eac6_ext_7.jpg saved to cache
2025-12-04 10:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 51536adf-85f9-5173-8b23-b3de10fde1e6
2025-12-04 10:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/BMW/X5?id=1430865&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231430865&indx=37> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 10:01:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 10:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1414418-4007407-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001414418-01988999-002.pdf)
2025-12-04 10:01:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:01:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ce3a1410>
2025-12-04 10:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:01:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:01:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51536adf-85f9-5173-8b23-b3de10fde1e6/51536adf-85f9-5173-8b23-b3de10fde1e6_image_1.jpg HTTP/1.1" 201 0
2025-12-04 10:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7e176b82-36f1-4b17-9f6a-88603b02eac6_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7e176b82-36f1-4b17-9f6a-88603b02eac6_ext_7.jpg saved to cache
2025-12-04 10:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 51536adf-85f9-5173-8b23-b3de10fde1e6
2025-12-04 10:01:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:01:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd1ded0>
2025-12-04 10:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:01:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:01:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51536adf-85f9-5173-8b23-b3de10fde1e6/51536adf-85f9-5173-8b23-b3de10fde1e6_image_2.jpg HTTP/1.1" 201 0
2025-12-04 10:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7e176b82-36f1-4b17-9f6a-88603b02eac6_ext_6.jpg') HTTP/1.1" 204 0
2025-12-04 10:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7e176b82-36f1-4b17-9f6a-88603b02eac6_ext_6.jpg saved to cache
2025-12-04 10:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 51536adf-85f9-5173-8b23-b3de10fde1e6
2025-12-04 10:01:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:01:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd481d0>
2025-12-04 10:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:01:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51536adf-85f9-5173-8b23-b3de10fde1e6/51536adf-85f9-5173-8b23-b3de10fde1e6_image_3.jpg HTTP/1.1" 201 0
2025-12-04 10:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7e176b82-36f1-4b17-9f6a-88603b02eac6_ext_1.jpg') HTTP/1.1" 204 0
2025-12-04 10:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7e176b82-36f1-4b17-9f6a-88603b02eac6_ext_1.jpg saved to cache
2025-12-04 10:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 51536adf-85f9-5173-8b23-b3de10fde1e6
2025-12-04 10:01:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:01:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd1ff50>
2025-12-04 10:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:01:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51536adf-85f9-5173-8b23-b3de10fde1e6/51536adf-85f9-5173-8b23-b3de10fde1e6_image_4.jpg HTTP/1.1" 201 0
2025-12-04 10:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7e176b82-36f1-4b17-9f6a-88603b02eac6_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7e176b82-36f1-4b17-9f6a-88603b02eac6_5.jpg saved to cache
2025-12-04 10:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 51536adf-85f9-5173-8b23-b3de10fde1e6
2025-12-04 10:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1414418-4007407-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001414418-01988999-002.pdf)
2025-12-04 10:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1414418-4007407-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001414418-01988999-002.pdf)
2025-12-04 10:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1414418-4007407-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001414418-01988999-002.pdf)
2025-12-04 10:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1414418-4007407-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001414418-01988999-002.pdf)
2025-12-04 10:01:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84d8ee3d-560c-5393-b556-6a347ebcff2a with identifier: 1430865
2025-12-04 10:01:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84d8ee3d-560c-5393-b556-6a347ebcff2a with scrape type 1
2025-12-04 10:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 17 photos for item 84d8ee3d-560c-5393-b556-6a347ebcff2a
2025-12-04 10:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fawaiting-image-002.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/awaiting-image-002.jpg already downloaded
2025-12-04 10:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fawaiting-image-002.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/awaiting-image-002.jpg already downloaded
2025-12-04 10:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1430865-4007722-3.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1430865-4007722-3.jpg not downloaded yet
2025-12-04 10:01:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:01:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc7e1390>
2025-12-04 10:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:01:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 10:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51536adf-85f9-5173-8b23-b3de10fde1e6/51536adf-85f9-5173-8b23-b3de10fde1e6_image_16.jpg HTTP/1.1" 201 0
2025-12-04 10:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1414418-4007407-1002.jpg') HTTP/1.1" 204 0
2025-12-04 10:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1414418-4007407-1002.jpg saved to cache
2025-12-04 10:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 51536adf-85f9-5173-8b23-b3de10fde1e6
2025-12-04 10:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1430865-4007722-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1430865-4007722-13.jpg not downloaded yet
2025-12-04 10:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1430865-4007722-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1430865-4007722-1000.jpg not downloaded yet
2025-12-04 10:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1414418-4007407-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001414418-01988999-002.pdf)
2025-12-04 10:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7e176b82-36f1-4b17-9f6a-88603b02eac6_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001414418-01988999-002.pdf)
2025-12-04 10:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7e176b82-36f1-4b17-9f6a-88603b02eac6_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001414418-01988999-002.pdf)
2025-12-04 10:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7e176b82-36f1-4b17-9f6a-88603b02eac6_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001414418-01988999-002.pdf)
2025-12-04 10:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1414418-4007407-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001414418-01988999-002.pdf)
2025-12-04 10:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7e176b82-36f1-4b17-9f6a-88603b02eac6_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001414418-01988999-002.pdf)
2025-12-04 10:01:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:01:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd0c1790>
2025-12-04 10:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:01:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51536adf-85f9-5173-8b23-b3de10fde1e6/51536adf-85f9-5173-8b23-b3de10fde1e6_image_14.jpg HTTP/1.1" 201 0
2025-12-04 10:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1414418-4007407-1000.jpg') HTTP/1.1" 204 0
2025-12-04 10:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1414418-4007407-1000.jpg saved to cache
2025-12-04 10:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 51536adf-85f9-5173-8b23-b3de10fde1e6
2025-12-04 10:01:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:01:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce77590>
2025-12-04 10:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:01:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51536adf-85f9-5173-8b23-b3de10fde1e6/51536adf-85f9-5173-8b23-b3de10fde1e6_image_17.jpg HTTP/1.1" 201 0
2025-12-04 10:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1414418-4007407-1003.jpg') HTTP/1.1" 204 0
2025-12-04 10:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1414418-4007407-1003.jpg saved to cache
2025-12-04 10:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 51536adf-85f9-5173-8b23-b3de10fde1e6
2025-12-04 10:01:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:01:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd30950>
2025-12-04 10:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:01:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51536adf-85f9-5173-8b23-b3de10fde1e6/51536adf-85f9-5173-8b23-b3de10fde1e6_image_15.jpg HTTP/1.1" 201 0
2025-12-04 10:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1414418-4007407-1001.jpg') HTTP/1.1" 204 0
2025-12-04 10:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1414418-4007407-1001.jpg saved to cache
2025-12-04 10:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 51536adf-85f9-5173-8b23-b3de10fde1e6
2025-12-04 10:01:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:01:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd093dd0>
2025-12-04 10:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:01:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51536adf-85f9-5173-8b23-b3de10fde1e6/51536adf-85f9-5173-8b23-b3de10fde1e6_image_13.jpg HTTP/1.1" 201 0
2025-12-04 10:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1414418-4007407-13.jpg') HTTP/1.1" 204 0
2025-12-04 10:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1414418-4007407-13.jpg saved to cache
2025-12-04 10:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 51536adf-85f9-5173-8b23-b3de10fde1e6
2025-12-04 10:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1430865-4007722-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1430865-4007722-1001.jpg not downloaded yet
2025-12-04 10:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1430865-4007722-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1430865-4007722-1002.jpg not downloaded yet
2025-12-04 10:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/BMW/1SERIES?id=1761741&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231761741&indx=64> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 10:01:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 10:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1430865-4007722-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1430865-4007722-1003.jpg not downloaded yet
2025-12-04 10:01:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:01:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc69c090>
2025-12-04 10:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:01:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51536adf-85f9-5173-8b23-b3de10fde1e6/51536adf-85f9-5173-8b23-b3de10fde1e6_image_18.jpg HTTP/1.1" 201 0
2025-12-04 10:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1414418-4007407-1004.jpg') HTTP/1.1" 204 0
2025-12-04 10:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1414418-4007407-1004.jpg saved to cache
2025-12-04 10:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 51536adf-85f9-5173-8b23-b3de10fde1e6
2025-12-04 10:01:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:01:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6b6d90>
2025-12-04 10:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:01:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51536adf-85f9-5173-8b23-b3de10fde1e6/51536adf-85f9-5173-8b23-b3de10fde1e6_image_11.jpg HTTP/1.1" 201 0
2025-12-04 10:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7e176b82-36f1-4b17-9f6a-88603b02eac6_ext_3.jpg') HTTP/1.1" 204 0
2025-12-04 10:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7e176b82-36f1-4b17-9f6a-88603b02eac6_ext_3.jpg saved to cache
2025-12-04 10:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 51536adf-85f9-5173-8b23-b3de10fde1e6
2025-12-04 10:01:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:01:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc69ea50>
2025-12-04 10:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:01:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51536adf-85f9-5173-8b23-b3de10fde1e6/51536adf-85f9-5173-8b23-b3de10fde1e6_image_10.jpg HTTP/1.1" 201 0
2025-12-04 10:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7e176b82-36f1-4b17-9f6a-88603b02eac6_ext_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7e176b82-36f1-4b17-9f6a-88603b02eac6_ext_5.jpg saved to cache
2025-12-04 10:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 51536adf-85f9-5173-8b23-b3de10fde1e6
2025-12-04 10:01:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:01:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6d2e50>
2025-12-04 10:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:01:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51536adf-85f9-5173-8b23-b3de10fde1e6/51536adf-85f9-5173-8b23-b3de10fde1e6_image_12.jpg HTTP/1.1" 201 0
2025-12-04 10:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7e176b82-36f1-4b17-9f6a-88603b02eac6_ext_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7e176b82-36f1-4b17-9f6a-88603b02eac6_ext_4.jpg saved to cache
2025-12-04 10:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 51536adf-85f9-5173-8b23-b3de10fde1e6
2025-12-04 10:01:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:01:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccc80dd0>
2025-12-04 10:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:01:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51536adf-85f9-5173-8b23-b3de10fde1e6/51536adf-85f9-5173-8b23-b3de10fde1e6_image_19.jpg HTTP/1.1" 201 0
2025-12-04 10:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1414418-4007407-1005.jpg') HTTP/1.1" 204 0
2025-12-04 10:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1414418-4007407-1005.jpg saved to cache
2025-12-04 10:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 51536adf-85f9-5173-8b23-b3de10fde1e6
2025-12-04 10:01:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:01:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd228190>
2025-12-04 10:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:01:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51536adf-85f9-5173-8b23-b3de10fde1e6/51536adf-85f9-5173-8b23-b3de10fde1e6_image_9.jpg HTTP/1.1" 201 0
2025-12-04 10:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7e176b82-36f1-4b17-9f6a-88603b02eac6_ext_2.jpg') HTTP/1.1" 204 0
2025-12-04 10:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7e176b82-36f1-4b17-9f6a-88603b02eac6_ext_2.jpg saved to cache
2025-12-04 10:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 51536adf-85f9-5173-8b23-b3de10fde1e6
2025-12-04 10:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7e176b82-36f1-4b17-9f6a-88603b02eac6_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001414418-01988999-002.pdf)
2025-12-04 10:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7e176b82-36f1-4b17-9f6a-88603b02eac6_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001414418-01988999-002.pdf)
2025-12-04 10:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1430865-4007722-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1430865-4007722-1004.jpg not downloaded yet
2025-12-04 10:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/SKODA/CITIGO?id=1506482&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231506482&indx=47> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 10:01:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08d45d44-06c8-5777-ab82-d212449d4408 with identifier: 1761741
2025-12-04 10:01:38 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 08d45d44-06c8-5777-ab82-d212449d4408
2025-12-04 10:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7e176b82-36f1-4b17-9f6a-88603b02eac6_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001414418-01988999-002.pdf)
2025-12-04 10:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7e176b82-36f1-4b17-9f6a-88603b02eac6_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001414418-01988999-002.pdf)
2025-12-04 10:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1430865-4007722-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1430865-4007722-1005.jpg not downloaded yet
2025-12-04 10:01:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 10:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1430865-4007722-13.jpg> (referer: None)
2025-12-04 10:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1430865-4007722-3.jpg> (referer: None)
2025-12-04 10:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1430865-4007722-1006.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1430865-4007722-1006.jpg not downloaded yet
2025-12-04 10:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1430865-4007722-1007.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1430865-4007722-1007.jpg not downloaded yet
2025-12-04 10:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1430865-4007722-1008.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1430865-4007722-1008.jpg not downloaded yet
2025-12-04 10:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1430865-4007722-1009.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1430865-4007722-1009.jpg not downloaded yet
2025-12-04 10:01:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:01:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce02d90>
2025-12-04 10:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:01:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51536adf-85f9-5173-8b23-b3de10fde1e6/51536adf-85f9-5173-8b23-b3de10fde1e6_image_8.jpg HTTP/1.1" 201 0
2025-12-04 10:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7e176b82-36f1-4b17-9f6a-88603b02eac6_9.jpg') HTTP/1.1" 204 0
2025-12-04 10:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7e176b82-36f1-4b17-9f6a-88603b02eac6_9.jpg saved to cache
2025-12-04 10:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 51536adf-85f9-5173-8b23-b3de10fde1e6
2025-12-04 10:01:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:01:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd83a90>
2025-12-04 10:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:01:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51536adf-85f9-5173-8b23-b3de10fde1e6/51536adf-85f9-5173-8b23-b3de10fde1e6_image_6.jpg HTTP/1.1" 201 0
2025-12-04 10:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7e176b82-36f1-4b17-9f6a-88603b02eac6_11.jpg') HTTP/1.1" 204 0
2025-12-04 10:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7e176b82-36f1-4b17-9f6a-88603b02eac6_11.jpg saved to cache
2025-12-04 10:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 51536adf-85f9-5173-8b23-b3de10fde1e6
2025-12-04 10:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1430865-4007722-1010.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1430865-4007722-1010.jpg not downloaded yet
2025-12-04 10:01:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27088f32-7263-59db-bbbd-a96a82d5699a with identifier: 1506482
2025-12-04 10:01:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27088f32-7263-59db-bbbd-a96a82d5699a with scrape type 1
2025-12-04 10:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 11 photos for item 27088f32-7263-59db-bbbd-a96a82d5699a
2025-12-04 10:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fawaiting-image-002.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/awaiting-image-002.jpg already downloaded
2025-12-04 10:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fawaiting-image-002.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/awaiting-image-002.jpg already downloaded
2025-12-04 10:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1506482-4007701-3.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1506482-4007701-3.jpg not downloaded yet
2025-12-04 10:01:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:01:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccc8e990>
2025-12-04 10:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:01:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51536adf-85f9-5173-8b23-b3de10fde1e6/51536adf-85f9-5173-8b23-b3de10fde1e6_image_5.jpg HTTP/1.1" 201 0
2025-12-04 10:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7e176b82-36f1-4b17-9f6a-88603b02eac6_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7e176b82-36f1-4b17-9f6a-88603b02eac6_4.jpg saved to cache
2025-12-04 10:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 51536adf-85f9-5173-8b23-b3de10fde1e6
2025-12-04 10:01:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:01:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd64ed0>
2025-12-04 10:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:01:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51536adf-85f9-5173-8b23-b3de10fde1e6/51536adf-85f9-5173-8b23-b3de10fde1e6_image_7.jpg HTTP/1.1" 201 0
2025-12-04 10:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7e176b82-36f1-4b17-9f6a-88603b02eac6_10.jpg') HTTP/1.1" 204 0
2025-12-04 10:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7e176b82-36f1-4b17-9f6a-88603b02eac6_10.jpg saved to cache
2025-12-04 10:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 51536adf-85f9-5173-8b23-b3de10fde1e6
2025-12-04 10:01:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 51536adf-85f9-5173-8b23-b3de10fde1e6, skipping ID generation
2025-12-04 10:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 51536adf-85f9-5173-8b23-b3de10fde1e6 from tracking dictionaries
2025-12-04 10:01:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 51536adf-85f9-5173-8b23-b3de10fde1e6 sending to next pipeline
2025-12-04 10:01:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 51536adf-85f9-5173-8b23-b3de10fde1e6, identifier: 1414418
2025-12-04 10:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1430865-4007722-1011.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1430865-4007722-1011.jpg not downloaded yet
2025-12-04 10:01:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 51536adf-85f9-5173-8b23-b3de10fde1e6 with identifier: 1414418
2025-12-04 10:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-04 10:01:40 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=WHITE HTTP/1.1" 200 None
2025-12-04 10:01:40 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-04 10:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-04 10:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-04 10:01:41 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Diesel HTTP/1.1" 200 None
2025-12-04 10:01:41 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-04 10:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-04 10:01:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 51536adf-85f9-5173-8b23-b3de10fde1e6 with identifier: 1414418
2025-12-04 10:01:41 [scrapy.core.scraper] INFO: Dropped: Dropping expired listing: 51536adf-85f9-5173-8b23-b3de10fde1e6 with expiration date: 2025-12-04T09:00:00Z
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51536adf-85f9-5173-8b23-b3de10fde1e6/51536adf-85f9-5173-8b23-b3de10fde1e6_expert_report_file_b41b1084-45e1-49d3-bff2-5ca3330f0123.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001414418-01988999-002.pdf',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '1.5L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '51536adf-85f9-5173-8b23-b3de10fde1e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'LT14UCH',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=1414418',
 'listing': 'auction',
 'location': 'Leeds',
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 94523,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 27,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51536adf-85f9-5173-8b23-b3de10fde1e6/51536adf-85f9-5173-8b23-b3de10fde1e6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 183209,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7e176b82-36f1-4b17-9f6a-88603b02eac6_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51536adf-85f9-5173-8b23-b3de10fde1e6/51536adf-85f9-5173-8b23-b3de10fde1e6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 183209,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7e176b82-36f1-4b17-9f6a-88603b02eac6_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51536adf-85f9-5173-8b23-b3de10fde1e6/51536adf-85f9-5173-8b23-b3de10fde1e6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 240933,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7e176b82-36f1-4b17-9f6a-88603b02eac6_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51536adf-85f9-5173-8b23-b3de10fde1e6/51536adf-85f9-5173-8b23-b3de10fde1e6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 198820,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7e176b82-36f1-4b17-9f6a-88603b02eac6_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51536adf-85f9-5173-8b23-b3de10fde1e6/51536adf-85f9-5173-8b23-b3de10fde1e6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 167618,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7e176b82-36f1-4b17-9f6a-88603b02eac6_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51536adf-85f9-5173-8b23-b3de10fde1e6/51536adf-85f9-5173-8b23-b3de10fde1e6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 176683,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7e176b82-36f1-4b17-9f6a-88603b02eac6_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51536adf-85f9-5173-8b23-b3de10fde1e6/51536adf-85f9-5173-8b23-b3de10fde1e6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 165900,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7e176b82-36f1-4b17-9f6a-88603b02eac6_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51536adf-85f9-5173-8b23-b3de10fde1e6/51536adf-85f9-5173-8b23-b3de10fde1e6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 178618,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7e176b82-36f1-4b17-9f6a-88603b02eac6_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51536adf-85f9-5173-8b23-b3de10fde1e6/51536adf-85f9-5173-8b23-b3de10fde1e6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 189847,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7e176b82-36f1-4b17-9f6a-88603b02eac6_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51536adf-85f9-5173-8b23-b3de10fde1e6/51536adf-85f9-5173-8b23-b3de10fde1e6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 244884,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7e176b82-36f1-4b17-9f6a-88603b02eac6_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51536adf-85f9-5173-8b23-b3de10fde1e6/51536adf-85f9-5173-8b23-b3de10fde1e6_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 198067,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7e176b82-36f1-4b17-9f6a-88603b02eac6_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51536adf-85f9-5173-8b23-b3de10fde1e6/51536adf-85f9-5173-8b23-b3de10fde1e6_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 215335,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7e176b82-36f1-4b17-9f6a-88603b02eac6_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51536adf-85f9-5173-8b23-b3de10fde1e6/51536adf-85f9-5173-8b23-b3de10fde1e6_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 201201,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7e176b82-36f1-4b17-9f6a-88603b02eac6_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51536adf-85f9-5173-8b23-b3de10fde1e6/51536adf-85f9-5173-8b23-b3de10fde1e6_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 338514,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1414418-4007407-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51536adf-85f9-5173-8b23-b3de10fde1e6/51536adf-85f9-5173-8b23-b3de10fde1e6_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 223050,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1414418-4007407-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51536adf-85f9-5173-8b23-b3de10fde1e6/51536adf-85f9-5173-8b23-b3de10fde1e6_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 357624,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1414418-4007407-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51536adf-85f9-5173-8b23-b3de10fde1e6/51536adf-85f9-5173-8b23-b3de10fde1e6_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 176747,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1414418-4007407-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51536adf-85f9-5173-8b23-b3de10fde1e6/51536adf-85f9-5173-8b23-b3de10fde1e6_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 292545,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1414418-4007407-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51536adf-85f9-5173-8b23-b3de10fde1e6/51536adf-85f9-5173-8b23-b3de10fde1e6_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 209602,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1414418-4007407-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51536adf-85f9-5173-8b23-b3de10fde1e6/51536adf-85f9-5173-8b23-b3de10fde1e6_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 234428,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1414418-4007407-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-03',
 'seller_name': 'Pentagon Group',
 'title': 'NISSAN QASHQAI 1.5 dCi Tekna 5dr',
 'transmission': 'manual',
 'trim': '1.5 dCi Tekna 5dr',
 'year': 2014}
2025-12-04 10:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271414418%27 HTTP/1.1" 200 None
2025-12-04 10:01:41 [manheim.gb] INFO: Saving data for 1414418: {'created_time': 1764842501.184042, 'last_price_update_time': 1764842501.18406, 'auction_closing_time': 1764838800.0}
2025-12-04 10:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1414418') HTTP/1.1" 204 0
2025-12-04 10:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1506482-4007701-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1506482-4007701-13.jpg not downloaded yet
2025-12-04 10:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1430865-4007722-1004.jpg> (referer: None)
2025-12-04 10:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1430865-4007722-1012.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1430865-4007722-1012.jpg not downloaded yet
2025-12-04 10:01:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:01:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc7e6cd0>
2025-12-04 10:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:01:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84d8ee3d-560c-5393-b556-6a347ebcff2a/84d8ee3d-560c-5393-b556-6a347ebcff2a_image_3.jpg HTTP/1.1" 201 0
2025-12-04 10:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1430865-4007722-13.jpg') HTTP/1.1" 204 0
2025-12-04 10:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1430865-4007722-13.jpg saved to cache
2025-12-04 10:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 84d8ee3d-560c-5393-b556-6a347ebcff2a
2025-12-04 10:01:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:01:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc68cf10>
2025-12-04 10:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:01:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 10:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84d8ee3d-560c-5393-b556-6a347ebcff2a/84d8ee3d-560c-5393-b556-6a347ebcff2a_image_2.jpg HTTP/1.1" 201 0
2025-12-04 10:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1430865-4007722-3.jpg') HTTP/1.1" 204 0
2025-12-04 10:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1430865-4007722-3.jpg saved to cache
2025-12-04 10:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 84d8ee3d-560c-5393-b556-6a347ebcff2a
2025-12-04 10:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1430865-4007722-1001.jpg> (referer: None)
2025-12-04 10:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1430865-4007722-1003.jpg> (referer: None)
2025-12-04 10:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1430865-4007722-1000.jpg> (referer: None)
2025-12-04 10:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1430865-4007722-1002.jpg> (referer: None)
2025-12-04 10:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1430865-4007722-1006.jpg> (referer: None)
2025-12-04 10:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1430865-4007722-1005.jpg> (referer: None)
2025-12-04 10:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1506482-4007701-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1506482-4007701-1000.jpg not downloaded yet
2025-12-04 10:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1506482-4007701-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1506482-4007701-1001.jpg not downloaded yet
2025-12-04 10:01:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:01:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd2e510>
2025-12-04 10:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:01:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84d8ee3d-560c-5393-b556-6a347ebcff2a/84d8ee3d-560c-5393-b556-6a347ebcff2a_image_8.jpg HTTP/1.1" 201 0
2025-12-04 10:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1430865-4007722-1004.jpg') HTTP/1.1" 204 0
2025-12-04 10:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1430865-4007722-1004.jpg saved to cache
2025-12-04 10:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 84d8ee3d-560c-5393-b556-6a347ebcff2a
2025-12-04 10:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1506482-4007701-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1506482-4007701-1002.jpg not downloaded yet
2025-12-04 10:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1506482-4007701-3.jpg> (referer: None)
2025-12-04 10:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1506482-4007701-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1506482-4007701-1003.jpg not downloaded yet
2025-12-04 10:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1430865-4007722-1010.jpg> (referer: None)
2025-12-04 10:01:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:01:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc651850>
2025-12-04 10:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:01:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 10:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84d8ee3d-560c-5393-b556-6a347ebcff2a/84d8ee3d-560c-5393-b556-6a347ebcff2a_image_5.jpg HTTP/1.1" 201 0
2025-12-04 10:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1430865-4007722-1001.jpg') HTTP/1.1" 204 0
2025-12-04 10:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1430865-4007722-1001.jpg saved to cache
2025-12-04 10:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 84d8ee3d-560c-5393-b556-6a347ebcff2a
2025-12-04 10:01:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:01:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6e6510>
2025-12-04 10:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:01:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84d8ee3d-560c-5393-b556-6a347ebcff2a/84d8ee3d-560c-5393-b556-6a347ebcff2a_image_7.jpg HTTP/1.1" 201 0
2025-12-04 10:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1430865-4007722-1003.jpg') HTTP/1.1" 204 0
2025-12-04 10:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1430865-4007722-1003.jpg saved to cache
2025-12-04 10:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 84d8ee3d-560c-5393-b556-6a347ebcff2a
2025-12-04 10:01:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:01:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd229690>
2025-12-04 10:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:01:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84d8ee3d-560c-5393-b556-6a347ebcff2a/84d8ee3d-560c-5393-b556-6a347ebcff2a_image_4.jpg HTTP/1.1" 201 0
2025-12-04 10:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1430865-4007722-1000.jpg') HTTP/1.1" 204 0
2025-12-04 10:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1430865-4007722-1000.jpg saved to cache
2025-12-04 10:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 84d8ee3d-560c-5393-b556-6a347ebcff2a
2025-12-04 10:01:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:01:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6e6110>
2025-12-04 10:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:01:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84d8ee3d-560c-5393-b556-6a347ebcff2a/84d8ee3d-560c-5393-b556-6a347ebcff2a_image_6.jpg HTTP/1.1" 201 0
2025-12-04 10:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1430865-4007722-1002.jpg') HTTP/1.1" 204 0
2025-12-04 10:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1430865-4007722-1002.jpg saved to cache
2025-12-04 10:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 84d8ee3d-560c-5393-b556-6a347ebcff2a
2025-12-04 10:01:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:01:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccec64d0>
2025-12-04 10:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:01:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84d8ee3d-560c-5393-b556-6a347ebcff2a/84d8ee3d-560c-5393-b556-6a347ebcff2a_image_10.jpg HTTP/1.1" 201 0
2025-12-04 10:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1430865-4007722-1006.jpg') HTTP/1.1" 204 0
2025-12-04 10:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1430865-4007722-1006.jpg saved to cache
2025-12-04 10:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 84d8ee3d-560c-5393-b556-6a347ebcff2a
2025-12-04 10:01:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:01:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccde9610>
2025-12-04 10:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:01:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84d8ee3d-560c-5393-b556-6a347ebcff2a/84d8ee3d-560c-5393-b556-6a347ebcff2a_image_9.jpg HTTP/1.1" 201 0
2025-12-04 10:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1430865-4007722-1005.jpg') HTTP/1.1" 204 0
2025-12-04 10:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1430865-4007722-1005.jpg saved to cache
2025-12-04 10:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 84d8ee3d-560c-5393-b556-6a347ebcff2a
2025-12-04 10:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1506482-4007701-13.jpg> (referer: None)
2025-12-04 10:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1430865-4007722-1008.jpg> (referer: None)
2025-12-04 10:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1430865-4007722-1009.jpg> (referer: None)
2025-12-04 10:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1430865-4007722-1007.jpg> (referer: None)
2025-12-04 10:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1506482-4007701-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1506482-4007701-1004.jpg not downloaded yet
2025-12-04 10:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1430865-4007722-1011.jpg> (referer: None)
2025-12-04 10:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1506482-4007701-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1506482-4007701-1005.jpg not downloaded yet
2025-12-04 10:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/HYUNDAI/IX20?id=1564179&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231564179&indx=53> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 10:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/refine> (referer: https://www.manheim.co.uk/search) ['zyte-api']
2025-12-04 10:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/LAND%20ROVER/DISCOVERYSPORT?id=2075642&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232075642&indx=91> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 10:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1506482-4007701-1006.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1506482-4007701-1006.jpg not downloaded yet
2025-12-04 10:01:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:01:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cf31ab50>
2025-12-04 10:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:01:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 10:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27088f32-7263-59db-bbbd-a96a82d5699a/27088f32-7263-59db-bbbd-a96a82d5699a_image_2.jpg HTTP/1.1" 201 0
2025-12-04 10:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1506482-4007701-3.jpg') HTTP/1.1" 204 0
2025-12-04 10:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1506482-4007701-3.jpg saved to cache
2025-12-04 10:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 27088f32-7263-59db-bbbd-a96a82d5699a
2025-12-04 10:01:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:01:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf09450>
2025-12-04 10:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:01:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84d8ee3d-560c-5393-b556-6a347ebcff2a/84d8ee3d-560c-5393-b556-6a347ebcff2a_image_14.jpg HTTP/1.1" 201 0
2025-12-04 10:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1430865-4007722-1010.jpg') HTTP/1.1" 204 0
2025-12-04 10:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1430865-4007722-1010.jpg saved to cache
2025-12-04 10:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 84d8ee3d-560c-5393-b556-6a347ebcff2a
2025-12-04 10:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1506482-4007701-1001.jpg> (referer: None)
2025-12-04 10:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1506482-4007701-1002.jpg> (referer: None)
2025-12-04 10:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1506482-4007701-1000.jpg> (referer: None)
2025-12-04 10:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1506482-4007701-1004.jpg> (referer: None)
2025-12-04 10:01:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:01:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc696950>
2025-12-04 10:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:01:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27088f32-7263-59db-bbbd-a96a82d5699a/27088f32-7263-59db-bbbd-a96a82d5699a_image_3.jpg HTTP/1.1" 201 0
2025-12-04 10:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1506482-4007701-13.jpg') HTTP/1.1" 204 0
2025-12-04 10:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1506482-4007701-13.jpg saved to cache
2025-12-04 10:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 27088f32-7263-59db-bbbd-a96a82d5699a
2025-12-04 10:01:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:01:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc69cc50>
2025-12-04 10:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:01:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84d8ee3d-560c-5393-b556-6a347ebcff2a/84d8ee3d-560c-5393-b556-6a347ebcff2a_image_12.jpg HTTP/1.1" 201 0
2025-12-04 10:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1430865-4007722-1008.jpg') HTTP/1.1" 204 0
2025-12-04 10:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1430865-4007722-1008.jpg saved to cache
2025-12-04 10:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 84d8ee3d-560c-5393-b556-6a347ebcff2a
2025-12-04 10:01:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:01:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc67f690>
2025-12-04 10:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:01:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84d8ee3d-560c-5393-b556-6a347ebcff2a/84d8ee3d-560c-5393-b556-6a347ebcff2a_image_13.jpg HTTP/1.1" 201 0
2025-12-04 10:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1430865-4007722-1009.jpg') HTTP/1.1" 204 0
2025-12-04 10:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1430865-4007722-1009.jpg saved to cache
2025-12-04 10:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 84d8ee3d-560c-5393-b556-6a347ebcff2a
2025-12-04 10:01:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:01:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cccd88d0>
2025-12-04 10:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:01:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84d8ee3d-560c-5393-b556-6a347ebcff2a/84d8ee3d-560c-5393-b556-6a347ebcff2a_image_11.jpg HTTP/1.1" 201 0
2025-12-04 10:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1430865-4007722-1007.jpg') HTTP/1.1" 204 0
2025-12-04 10:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1430865-4007722-1007.jpg saved to cache
2025-12-04 10:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 84d8ee3d-560c-5393-b556-6a347ebcff2a
2025-12-04 10:01:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:01:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf5aa50>
2025-12-04 10:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:01:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84d8ee3d-560c-5393-b556-6a347ebcff2a/84d8ee3d-560c-5393-b556-6a347ebcff2a_image_15.jpg HTTP/1.1" 201 0
2025-12-04 10:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1430865-4007722-1011.jpg') HTTP/1.1" 204 0
2025-12-04 10:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1430865-4007722-1011.jpg saved to cache
2025-12-04 10:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 84d8ee3d-560c-5393-b556-6a347ebcff2a
2025-12-04 10:01:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9200c31a-aec5-5dca-8036-0876fcfb70f2 with identifier: 1564179
2025-12-04 10:01:48 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 9200c31a-aec5-5dca-8036-0876fcfb70f2
2025-12-04 10:01:48 [manheim.gb] INFO: Found listing with ID: 2968609
2025-12-04 10:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272968609%27 HTTP/1.1" 200 None
2025-12-04 10:01:48 [manheim.gb] INFO: Scrape type for 2968609: 0
2025-12-04 10:01:48 [manheim.gb] INFO: Found listing with ID: 2976938
2025-12-04 10:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272976938%27 HTTP/1.1" 200 None
2025-12-04 10:01:48 [manheim.gb] INFO: Scrape type for 2976938: 0
2025-12-04 10:01:48 [manheim.gb] INFO: Found listing with ID: 2983373
2025-12-04 10:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272983373%27 HTTP/1.1" 200 None
2025-12-04 10:01:48 [manheim.gb] INFO: Scrape type for 2983373: 0
2025-12-04 10:01:48 [manheim.gb] INFO: Found listing with ID: 3000496
2025-12-04 10:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273000496%27 HTTP/1.1" 200 None
2025-12-04 10:01:48 [manheim.gb] INFO: Scrape type for 3000496: 0
2025-12-04 10:01:48 [manheim.gb] INFO: Found listing with ID: 3004217
2025-12-04 10:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273004217%27 HTTP/1.1" 200 None
2025-12-04 10:01:48 [manheim.gb] INFO: Scrape type for 3004217: 0
2025-12-04 10:01:48 [manheim.gb] INFO: Found listing with ID: 3017186
2025-12-04 10:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273017186%27 HTTP/1.1" 200 None
2025-12-04 10:01:48 [manheim.gb] INFO: Scrape type for 3017186: 0
2025-12-04 10:01:48 [manheim.gb] INFO: Found listing with ID: 3046148
2025-12-04 10:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273046148%27 HTTP/1.1" 200 None
2025-12-04 10:01:48 [manheim.gb] INFO: Scrape type for 3046148: 0
2025-12-04 10:01:48 [manheim.gb] INFO: Found listing with ID: 3049627
2025-12-04 10:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273049627%27 HTTP/1.1" 200 None
2025-12-04 10:01:48 [manheim.gb] INFO: Scrape type for 3049627: 0
2025-12-04 10:01:48 [manheim.gb] INFO: Found listing with ID: 3052566
2025-12-04 10:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273052566%27 HTTP/1.1" 200 None
2025-12-04 10:01:48 [manheim.gb] INFO: Scrape type for 3052566: 0
2025-12-04 10:01:48 [manheim.gb] INFO: Found listing with ID: 3054349
2025-12-04 10:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273054349%27 HTTP/1.1" 200 None
2025-12-04 10:01:48 [manheim.gb] INFO: Scrape type for 3054349: 0
2025-12-04 10:01:48 [manheim.gb] INFO: Found listing with ID: 3058021
2025-12-04 10:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273058021%27 HTTP/1.1" 200 None
2025-12-04 10:01:48 [manheim.gb] INFO: Scrape type for 3058021: 0
2025-12-04 10:01:48 [manheim.gb] INFO: Found listing with ID: 3060716
2025-12-04 10:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273060716%27 HTTP/1.1" 200 None
2025-12-04 10:01:48 [manheim.gb] INFO: Scrape type for 3060716: 1
2025-12-04 10:01:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 830b15cf-d0d5-5221-9d29-e2fb63578fe6 with identifier: 2075642
2025-12-04 10:01:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 830b15cf-d0d5-5221-9d29-e2fb63578fe6 with scrape type 2
2025-12-04 10:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 830b15cf-d0d5-5221-9d29-e2fb63578fe6 with scrape type 2
2025-12-04 10:01:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 830b15cf-d0d5-5221-9d29-e2fb63578fe6, identifier: 2075642
2025-12-04 10:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1430865-4007722-1012.jpg> (referer: None)
2025-12-04 10:01:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 830b15cf-d0d5-5221-9d29-e2fb63578fe6 with identifier: 2075642
2025-12-04 10:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-04 10:01:49 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Silver HTTP/1.1" 200 None
2025-12-04 10:01:49 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-04 10:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-04 10:01:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 830b15cf-d0d5-5221-9d29-e2fb63578fe6 with identifier: 2075642
2025-12-04 10:01:49 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 830b15cf-d0d5-5221-9d29-e2fb63578fe6 with identifier: 2075642 to the API
2025-12-04 10:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 10:01:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 10:01:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/LAND%20ROVER/DISCOVERYSPORT?id=2075642&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232075642&indx=91>
{'auction_title': '',
 'c_o_2_emission_value': 169,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002075642-01981819-003.pdf',
 'color': 'Silver',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '830b15cf-d0d5-5221-9d29-e2fb63578fe6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'KW67VOU',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/LAND%20ROVER/DISCOVERY%20SPORT?id=2075642',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'LAND ROVER',
 'model': 'DISCOVERY SPORT',
 'odometer': 37182,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-20',
 'seller_name': 'Lookers',
 'title': 'LAND ROVER DISCOVERY SPORT 2.0 SD4 240 HSE Dynamic Luxury 5dr Auto',
 'transmission': 'automatic',
 'trim': '2.0 SD4 240 HSE Dynamic Luxury 5dr Auto',
 'year': 2017}
2025-12-04 10:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272075642%27 HTTP/1.1" 200 None
2025-12-04 10:01:49 [manheim.gb] INFO: Saving data for 2075642: {'auction_closing_time': 1765270800.0, 'created_time': 1764583968.866378, 'last_price_update_time': 1764842509.586363}
2025-12-04 10:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2075642') HTTP/1.1" 204 0
2025-12-04 10:01:49 [manheim.gb] INFO: Found listing with ID: 3066375
2025-12-04 10:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273066375%27 HTTP/1.1" 200 None
2025-12-04 10:01:49 [manheim.gb] INFO: Scrape type for 3066375: 0
2025-12-04 10:01:49 [manheim.gb] INFO: Found listing with ID: 3093098
2025-12-04 10:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273093098%27 HTTP/1.1" 200 None
2025-12-04 10:01:49 [manheim.gb] INFO: Scrape type for 3093098: 0
2025-12-04 10:01:49 [manheim.gb] INFO: Found listing with ID: 3093456
2025-12-04 10:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273093456%27 HTTP/1.1" 200 None
2025-12-04 10:01:49 [manheim.gb] INFO: Scrape type for 3093456: 0
2025-12-04 10:01:49 [manheim.gb] INFO: Found listing with ID: 3107402
2025-12-04 10:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273107402%27 HTTP/1.1" 200 None
2025-12-04 10:01:49 [manheim.gb] INFO: Scrape type for 3107402: 0
2025-12-04 10:01:49 [manheim.gb] INFO: Found listing with ID: 3112958
2025-12-04 10:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273112958%27 HTTP/1.1" 200 None
2025-12-04 10:01:49 [manheim.gb] INFO: Scrape type for 3112958: 0
2025-12-04 10:01:49 [manheim.gb] INFO: Found listing with ID: 3120849
2025-12-04 10:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273120849%27 HTTP/1.1" 200 None
2025-12-04 10:01:49 [manheim.gb] INFO: Scrape type for 3120849: 0
2025-12-04 10:01:49 [manheim.gb] INFO: Found listing with ID: 3132401
2025-12-04 10:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273132401%27 HTTP/1.1" 200 None
2025-12-04 10:01:49 [manheim.gb] INFO: Scrape type for 3132401: 0
2025-12-04 10:01:49 [manheim.gb] INFO: Found listing with ID: 3148192
2025-12-04 10:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273148192%27 HTTP/1.1" 200 None
2025-12-04 10:01:49 [manheim.gb] INFO: Scrape type for 3148192: 0
2025-12-04 10:01:49 [manheim.gb] INFO: Found listing with ID: 3154376
2025-12-04 10:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273154376%27 HTTP/1.1" 200 None
2025-12-04 10:01:50 [manheim.gb] INFO: Scrape type for 3154376: 0
2025-12-04 10:01:50 [manheim.gb] INFO: Found listing with ID: 3161787
2025-12-04 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273161787%27 HTTP/1.1" 200 None
2025-12-04 10:01:50 [manheim.gb] INFO: Scrape type for 3161787: 0
2025-12-04 10:01:50 [manheim.gb] INFO: Found listing with ID: 3163606
2025-12-04 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273163606%27 HTTP/1.1" 200 None
2025-12-04 10:01:50 [manheim.gb] INFO: Scrape type for 3163606: 0
2025-12-04 10:01:50 [manheim.gb] INFO: Found listing with ID: 3167377
2025-12-04 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273167377%27 HTTP/1.1" 200 None
2025-12-04 10:01:50 [manheim.gb] INFO: Scrape type for 3167377: 0
2025-12-04 10:01:50 [manheim.gb] INFO: Found listing with ID: 3171741
2025-12-04 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273171741%27 HTTP/1.1" 200 None
2025-12-04 10:01:50 [manheim.gb] INFO: Scrape type for 3171741: 0
2025-12-04 10:01:50 [manheim.gb] INFO: Found listing with ID: 3174678
2025-12-04 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273174678%27 HTTP/1.1" 200 None
2025-12-04 10:01:50 [manheim.gb] INFO: Scrape type for 3174678: 0
2025-12-04 10:01:50 [manheim.gb] INFO: Found listing with ID: 3193354
2025-12-04 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273193354%27 HTTP/1.1" 200 None
2025-12-04 10:01:50 [manheim.gb] INFO: Scrape type for 3193354: 0
2025-12-04 10:01:50 [manheim.gb] INFO: Found listing with ID: 3194283
2025-12-04 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273194283%27 HTTP/1.1" 200 None
2025-12-04 10:01:50 [manheim.gb] INFO: Scrape type for 3194283: 0
2025-12-04 10:01:50 [manheim.gb] INFO: Found listing with ID: 320240
2025-12-04 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27320240%27 HTTP/1.1" 200 None
2025-12-04 10:01:50 [manheim.gb] INFO: Scrape type for 320240: 1
2025-12-04 10:01:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 10:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1506482-4007701-1003.jpg> (referer: None)
2025-12-04 10:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=1966868&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231966868&indx=81> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 10:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/MAZDA/2?id=2247450&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232247450&indx=104> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 10:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1506482-4007701-1005.jpg> (referer: None)
2025-12-04 10:01:50 [manheim.gb] INFO: Found listing with ID: 3204178
2025-12-04 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273204178%27 HTTP/1.1" 200 None
2025-12-04 10:01:50 [manheim.gb] INFO: Scrape type for 3204178: 0
2025-12-04 10:01:50 [manheim.gb] INFO: Found listing with ID: 3209297
2025-12-04 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273209297%27 HTTP/1.1" 200 None
2025-12-04 10:01:50 [manheim.gb] INFO: Scrape type for 3209297: 0
2025-12-04 10:01:50 [manheim.gb] INFO: Found listing with ID: 3210152
2025-12-04 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273210152%27 HTTP/1.1" 200 None
2025-12-04 10:01:50 [manheim.gb] INFO: Scrape type for 3210152: 0
2025-12-04 10:01:50 [manheim.gb] INFO: Found listing with ID: 3213348
2025-12-04 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273213348%27 HTTP/1.1" 200 None
2025-12-04 10:01:50 [manheim.gb] INFO: Scrape type for 3213348: 0
2025-12-04 10:01:50 [manheim.gb] INFO: Found listing with ID: 3227836
2025-12-04 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273227836%27 HTTP/1.1" 200 None
2025-12-04 10:01:50 [manheim.gb] INFO: Scrape type for 3227836: 0
2025-12-04 10:01:50 [manheim.gb] INFO: Found listing with ID: 3234444
2025-12-04 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273234444%27 HTTP/1.1" 200 None
2025-12-04 10:01:50 [manheim.gb] INFO: Scrape type for 3234444: 0
2025-12-04 10:01:50 [manheim.gb] INFO: Found listing with ID: 3235123
2025-12-04 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273235123%27 HTTP/1.1" 200 None
2025-12-04 10:01:50 [manheim.gb] INFO: Scrape type for 3235123: 0
2025-12-04 10:01:50 [manheim.gb] INFO: Found listing with ID: 3235969
2025-12-04 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273235969%27 HTTP/1.1" 200 None
2025-12-04 10:01:50 [manheim.gb] INFO: Scrape type for 3235969: 0
2025-12-04 10:01:50 [manheim.gb] INFO: Found listing with ID: 3243502
2025-12-04 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273243502%27 HTTP/1.1" 200 None
2025-12-04 10:01:50 [manheim.gb] INFO: Scrape type for 3243502: 0
2025-12-04 10:01:50 [manheim.gb] INFO: Found listing with ID: 3267329
2025-12-04 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273267329%27 HTTP/1.1" 200 None
2025-12-04 10:01:50 [manheim.gb] INFO: Scrape type for 3267329: 0
2025-12-04 10:01:50 [manheim.gb] INFO: Found listing with ID: 3267872
2025-12-04 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273267872%27 HTTP/1.1" 200 None
2025-12-04 10:01:50 [manheim.gb] INFO: Scrape type for 3267872: 0
2025-12-04 10:01:50 [manheim.gb] INFO: Found listing with ID: 3272956
2025-12-04 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273272956%27 HTTP/1.1" 200 None
2025-12-04 10:01:50 [manheim.gb] INFO: Scrape type for 3272956: 0
2025-12-04 10:01:50 [manheim.gb] INFO: Found listing with ID: 3276436
2025-12-04 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273276436%27 HTTP/1.1" 200 None
2025-12-04 10:01:50 [manheim.gb] INFO: Scrape type for 3276436: 0
2025-12-04 10:01:50 [manheim.gb] INFO: Found listing with ID: 3278878
2025-12-04 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273278878%27 HTTP/1.1" 200 None
2025-12-04 10:01:50 [manheim.gb] INFO: Scrape type for 3278878: 0
2025-12-04 10:01:50 [manheim.gb] INFO: Found listing with ID: 3288325
2025-12-04 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273288325%27 HTTP/1.1" 200 None
2025-12-04 10:01:50 [manheim.gb] INFO: Scrape type for 3288325: 0
2025-12-04 10:01:50 [manheim.gb] INFO: Found listing with ID: 3290272
2025-12-04 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273290272%27 HTTP/1.1" 200 None
2025-12-04 10:01:50 [manheim.gb] INFO: Scrape type for 3290272: 0
2025-12-04 10:01:50 [manheim.gb] INFO: Found listing with ID: 3292131
2025-12-04 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273292131%27 HTTP/1.1" 200 None
2025-12-04 10:01:50 [manheim.gb] INFO: Scrape type for 3292131: 0
2025-12-04 10:01:50 [manheim.gb] INFO: Found listing with ID: 3296314
2025-12-04 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273296314%27 HTTP/1.1" 200 None
2025-12-04 10:01:50 [manheim.gb] INFO: Scrape type for 3296314: 0
2025-12-04 10:01:50 [manheim.gb] INFO: Found listing with ID: 3300121
2025-12-04 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273300121%27 HTTP/1.1" 200 None
2025-12-04 10:01:50 [manheim.gb] INFO: Scrape type for 3300121: 0
2025-12-04 10:01:50 [manheim.gb] INFO: Found listing with ID: 3303034
2025-12-04 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273303034%27 HTTP/1.1" 200 None
2025-12-04 10:01:50 [manheim.gb] INFO: Scrape type for 3303034: 0
2025-12-04 10:01:50 [manheim.gb] INFO: Found listing with ID: 3303846
2025-12-04 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273303846%27 HTTP/1.1" 200 None
2025-12-04 10:01:50 [manheim.gb] INFO: Scrape type for 3303846: 0
2025-12-04 10:01:50 [manheim.gb] INFO: Found listing with ID: 3305808
2025-12-04 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273305808%27 HTTP/1.1" 200 None
2025-12-04 10:01:50 [manheim.gb] INFO: Scrape type for 3305808: 0
2025-12-04 10:01:50 [manheim.gb] INFO: Found listing with ID: 3305810
2025-12-04 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273305810%27 HTTP/1.1" 200 None
2025-12-04 10:01:50 [manheim.gb] INFO: Scrape type for 3305810: 0
2025-12-04 10:01:50 [manheim.gb] INFO: Found listing with ID: 3318690
2025-12-04 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273318690%27 HTTP/1.1" 200 None
2025-12-04 10:01:50 [manheim.gb] INFO: Scrape type for 3318690: 0
2025-12-04 10:01:50 [manheim.gb] INFO: Found listing with ID: 3331358
2025-12-04 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273331358%27 HTTP/1.1" 200 None
2025-12-04 10:01:50 [manheim.gb] INFO: Scrape type for 3331358: 0
2025-12-04 10:01:50 [manheim.gb] INFO: Found listing with ID: 3333029
2025-12-04 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273333029%27 HTTP/1.1" 200 None
2025-12-04 10:01:50 [manheim.gb] INFO: Scrape type for 3333029: 0
2025-12-04 10:01:50 [manheim.gb] INFO: Found listing with ID: 3338104
2025-12-04 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273338104%27 HTTP/1.1" 200 None
2025-12-04 10:01:50 [manheim.gb] INFO: Scrape type for 3338104: 0
2025-12-04 10:01:50 [manheim.gb] INFO: Found listing with ID: 3338885
2025-12-04 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273338885%27 HTTP/1.1" 200 None
2025-12-04 10:01:50 [manheim.gb] INFO: Scrape type for 3338885: 0
2025-12-04 10:01:50 [manheim.gb] INFO: Found listing with ID: 3342805
2025-12-04 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273342805%27 HTTP/1.1" 200 None
2025-12-04 10:01:50 [manheim.gb] INFO: Scrape type for 3342805: 0
2025-12-04 10:01:50 [manheim.gb] INFO: Found listing with ID: 3348750
2025-12-04 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273348750%27 HTTP/1.1" 200 None
2025-12-04 10:01:50 [manheim.gb] INFO: Scrape type for 3348750: 0
2025-12-04 10:01:50 [manheim.gb] INFO: Found listing with ID: 3350164
2025-12-04 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273350164%27 HTTP/1.1" 200 None
2025-12-04 10:01:50 [manheim.gb] INFO: Scrape type for 3350164: 0
2025-12-04 10:01:50 [manheim.gb] INFO: Found listing with ID: 3352809
2025-12-04 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273352809%27 HTTP/1.1" 200 None
2025-12-04 10:01:50 [manheim.gb] INFO: Scrape type for 3352809: 0
2025-12-04 10:01:50 [manheim.gb] INFO: Found listing with ID: 3356576
2025-12-04 10:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273356576%27 HTTP/1.1" 200 None
2025-12-04 10:01:51 [manheim.gb] INFO: Scrape type for 3356576: 0
2025-12-04 10:01:51 [manheim.gb] INFO: Found listing with ID: 3358545
2025-12-04 10:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273358545%27 HTTP/1.1" 200 None
2025-12-04 10:01:51 [manheim.gb] INFO: Scrape type for 3358545: 0
2025-12-04 10:01:51 [manheim.gb] INFO: Found listing with ID: 3366127
2025-12-04 10:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273366127%27 HTTP/1.1" 200 None
2025-12-04 10:01:51 [manheim.gb] INFO: Scrape type for 3366127: 0
2025-12-04 10:01:51 [manheim.gb] INFO: Found listing with ID: 3367434
2025-12-04 10:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273367434%27 HTTP/1.1" 200 None
2025-12-04 10:01:51 [manheim.gb] INFO: Scrape type for 3367434: 1
2025-12-04 10:01:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 10:01:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:01:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd036b90>
2025-12-04 10:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:01:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27088f32-7263-59db-bbbd-a96a82d5699a/27088f32-7263-59db-bbbd-a96a82d5699a_image_5.jpg HTTP/1.1" 201 0
2025-12-04 10:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1506482-4007701-1001.jpg') HTTP/1.1" 204 0
2025-12-04 10:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1506482-4007701-1001.jpg saved to cache
2025-12-04 10:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 27088f32-7263-59db-bbbd-a96a82d5699a
2025-12-04 10:01:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:01:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccedaa50>
2025-12-04 10:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:01:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27088f32-7263-59db-bbbd-a96a82d5699a/27088f32-7263-59db-bbbd-a96a82d5699a_image_6.jpg HTTP/1.1" 201 0
2025-12-04 10:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1506482-4007701-1002.jpg') HTTP/1.1" 204 0
2025-12-04 10:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1506482-4007701-1002.jpg saved to cache
2025-12-04 10:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 27088f32-7263-59db-bbbd-a96a82d5699a
2025-12-04 10:01:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:01:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd0c10d0>
2025-12-04 10:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:01:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27088f32-7263-59db-bbbd-a96a82d5699a/27088f32-7263-59db-bbbd-a96a82d5699a_image_4.jpg HTTP/1.1" 201 0
2025-12-04 10:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1506482-4007701-1000.jpg') HTTP/1.1" 204 0
2025-12-04 10:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1506482-4007701-1000.jpg saved to cache
2025-12-04 10:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 27088f32-7263-59db-bbbd-a96a82d5699a
2025-12-04 10:01:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:01:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc725c50>
2025-12-04 10:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:01:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27088f32-7263-59db-bbbd-a96a82d5699a/27088f32-7263-59db-bbbd-a96a82d5699a_image_8.jpg HTTP/1.1" 201 0
2025-12-04 10:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1506482-4007701-1004.jpg') HTTP/1.1" 204 0
2025-12-04 10:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1506482-4007701-1004.jpg saved to cache
2025-12-04 10:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 27088f32-7263-59db-bbbd-a96a82d5699a
2025-12-04 10:01:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:01:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce11650>
2025-12-04 10:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:01:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84d8ee3d-560c-5393-b556-6a347ebcff2a/84d8ee3d-560c-5393-b556-6a347ebcff2a_image_16.jpg HTTP/1.1" 201 0
2025-12-04 10:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1430865-4007722-1012.jpg') HTTP/1.1" 204 0
2025-12-04 10:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1430865-4007722-1012.jpg saved to cache
2025-12-04 10:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 84d8ee3d-560c-5393-b556-6a347ebcff2a
2025-12-04 10:01:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 84d8ee3d-560c-5393-b556-6a347ebcff2a, skipping ID generation
2025-12-04 10:01:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84d8ee3d-560c-5393-b556-6a347ebcff2a with scrape type 1
2025-12-04 10:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 84d8ee3d-560c-5393-b556-6a347ebcff2a from tracking dictionaries
2025-12-04 10:01:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 84d8ee3d-560c-5393-b556-6a347ebcff2a sending to next pipeline
2025-12-04 10:01:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 84d8ee3d-560c-5393-b556-6a347ebcff2a, identifier: 1430865
2025-12-04 10:01:52 [manheim.gb] INFO: Found listing with ID: 3367441
2025-12-04 10:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273367441%27 HTTP/1.1" 200 None
2025-12-04 10:01:52 [manheim.gb] INFO: Scrape type for 3367441: 1
2025-12-04 10:01:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 84d8ee3d-560c-5393-b556-6a347ebcff2a with identifier: 1430865
2025-12-04 10:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-04 10:01:52 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=BLACK HTTP/1.1" 200 None
2025-12-04 10:01:52 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-04 10:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-04 10:01:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 84d8ee3d-560c-5393-b556-6a347ebcff2a with identifier: 1430865
2025-12-04 10:01:53 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 10 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    10
2025-12-04 10:01:53 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: 84d8ee3d-560c-5393-b556-6a347ebcff2a spider: manheim.gb
2025-12-04 10:01:53 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 84d8ee3d-560c-5393-b556-6a347ebcff2a due to rule: registration_date_old.json, error: 10 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    10
{'auction_title': '',
 'c_o_2_emission_value': 158,
 'car_expert_report_source_url': None,
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '3.0L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '84d8ee3d-560c-5393-b556-6a347ebcff2a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'LG65HYT',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/BMW/X5?id=1430865',
 'listing': 'auction',
 'location': 'Leeds',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 81094,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4622c3ba-5515-5758-814e-2f49e4247fa1/4622c3ba-5515-5758-814e-2f49e4247fa1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72484,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/awaiting-image-002.jpg',
             'Width': 1322},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4622c3ba-5515-5758-814e-2f49e4247fa1/4622c3ba-5515-5758-814e-2f49e4247fa1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72484,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/awaiting-image-002.jpg',
             'Width': 1322},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84d8ee3d-560c-5393-b556-6a347ebcff2a/84d8ee3d-560c-5393-b556-6a347ebcff2a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 205108,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1430865-4007722-3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84d8ee3d-560c-5393-b556-6a347ebcff2a/84d8ee3d-560c-5393-b556-6a347ebcff2a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 322951,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1430865-4007722-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84d8ee3d-560c-5393-b556-6a347ebcff2a/84d8ee3d-560c-5393-b556-6a347ebcff2a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 311317,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1430865-4007722-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84d8ee3d-560c-5393-b556-6a347ebcff2a/84d8ee3d-560c-5393-b556-6a347ebcff2a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 312654,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1430865-4007722-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84d8ee3d-560c-5393-b556-6a347ebcff2a/84d8ee3d-560c-5393-b556-6a347ebcff2a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 288600,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1430865-4007722-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84d8ee3d-560c-5393-b556-6a347ebcff2a/84d8ee3d-560c-5393-b556-6a347ebcff2a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 292615,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1430865-4007722-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84d8ee3d-560c-5393-b556-6a347ebcff2a/84d8ee3d-560c-5393-b556-6a347ebcff2a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 216312,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1430865-4007722-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84d8ee3d-560c-5393-b556-6a347ebcff2a/84d8ee3d-560c-5393-b556-6a347ebcff2a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 280465,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1430865-4007722-1005.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84d8ee3d-560c-5393-b556-6a347ebcff2a/84d8ee3d-560c-5393-b556-6a347ebcff2a_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 312585,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1430865-4007722-1006.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84d8ee3d-560c-5393-b556-6a347ebcff2a/84d8ee3d-560c-5393-b556-6a347ebcff2a_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 325099,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1430865-4007722-1007.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84d8ee3d-560c-5393-b556-6a347ebcff2a/84d8ee3d-560c-5393-b556-6a347ebcff2a_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 267001,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1430865-4007722-1008.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84d8ee3d-560c-5393-b556-6a347ebcff2a/84d8ee3d-560c-5393-b556-6a347ebcff2a_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 266831,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1430865-4007722-1009.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84d8ee3d-560c-5393-b556-6a347ebcff2a/84d8ee3d-560c-5393-b556-6a347ebcff2a_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 219320,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1430865-4007722-1010.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84d8ee3d-560c-5393-b556-6a347ebcff2a/84d8ee3d-560c-5393-b556-6a347ebcff2a_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 361815,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1430865-4007722-1011.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84d8ee3d-560c-5393-b556-6a347ebcff2a/84d8ee3d-560c-5393-b556-6a347ebcff2a_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 311940,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1430865-4007722-1012.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-07',
 'seller_name': 'Lookers',
 'title': 'BMW X5 xDrive30d M Sport 5dr Auto [7 Seat]',
 'transmission': 'automatic',
 'trim': 'xDrive30d M Sport 5dr Auto [7 Seat]',
 'year': 2015}
2025-12-04 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271430865%27 HTTP/1.1" 200 None
2025-12-04 10:01:53 [manheim.gb] INFO: Saving data for 1430865: {'created_time': 1764842513.268707, 'last_price_update_time': 1764842513.268719, 'auction_closing_time': 1765184400.0}
2025-12-04 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1430865') HTTP/1.1" 204 0
2025-12-04 10:01:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 10:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1506482-4007701-1006.jpg> (referer: None)
2025-12-04 10:01:53 [manheim.gb] INFO: Found listing with ID: 3368334
2025-12-04 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273368334%27 HTTP/1.1" 200 None
2025-12-04 10:01:53 [manheim.gb] INFO: Scrape type for 3368334: 0
2025-12-04 10:01:53 [manheim.gb] INFO: Found listing with ID: 3376327
2025-12-04 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273376327%27 HTTP/1.1" 200 None
2025-12-04 10:01:53 [manheim.gb] INFO: Scrape type for 3376327: 0
2025-12-04 10:01:53 [manheim.gb] INFO: Found listing with ID: 3387097
2025-12-04 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273387097%27 HTTP/1.1" 200 None
2025-12-04 10:01:53 [manheim.gb] INFO: Scrape type for 3387097: 0
2025-12-04 10:01:53 [manheim.gb] INFO: Found listing with ID: 3409801
2025-12-04 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273409801%27 HTTP/1.1" 200 None
2025-12-04 10:01:53 [manheim.gb] INFO: Scrape type for 3409801: 0
2025-12-04 10:01:53 [manheim.gb] INFO: Found listing with ID: 3417454
2025-12-04 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273417454%27 HTTP/1.1" 200 None
2025-12-04 10:01:53 [manheim.gb] INFO: Scrape type for 3417454: 0
2025-12-04 10:01:53 [manheim.gb] INFO: Found listing with ID: 3432289
2025-12-04 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273432289%27 HTTP/1.1" 200 None
2025-12-04 10:01:53 [manheim.gb] INFO: Scrape type for 3432289: 0
2025-12-04 10:01:53 [manheim.gb] INFO: Found listing with ID: 3432714
2025-12-04 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273432714%27 HTTP/1.1" 200 None
2025-12-04 10:01:53 [manheim.gb] INFO: Scrape type for 3432714: 0
2025-12-04 10:01:53 [manheim.gb] INFO: Found listing with ID: 343802
2025-12-04 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27343802%27 HTTP/1.1" 200 None
2025-12-04 10:01:53 [manheim.gb] INFO: Scrape type for 343802: 0
2025-12-04 10:01:53 [manheim.gb] INFO: Found listing with ID: 3445714
2025-12-04 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273445714%27 HTTP/1.1" 200 None
2025-12-04 10:01:53 [manheim.gb] INFO: Scrape type for 3445714: 0
2025-12-04 10:01:53 [manheim.gb] INFO: Found listing with ID: 3485191
2025-12-04 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273485191%27 HTTP/1.1" 200 None
2025-12-04 10:01:53 [manheim.gb] INFO: Scrape type for 3485191: 0
2025-12-04 10:01:53 [manheim.gb] INFO: Found listing with ID: 3486378
2025-12-04 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273486378%27 HTTP/1.1" 200 None
2025-12-04 10:01:53 [manheim.gb] INFO: Scrape type for 3486378: 0
2025-12-04 10:01:53 [manheim.gb] INFO: Found listing with ID: 3507560
2025-12-04 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273507560%27 HTTP/1.1" 200 None
2025-12-04 10:01:53 [manheim.gb] INFO: Scrape type for 3507560: 0
2025-12-04 10:01:53 [manheim.gb] INFO: Found listing with ID: 3512008
2025-12-04 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273512008%27 HTTP/1.1" 200 None
2025-12-04 10:01:53 [manheim.gb] INFO: Scrape type for 3512008: 1
2025-12-04 10:01:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:01:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:01:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:01:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd0d9650>
2025-12-04 10:01:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:01:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:01:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27088f32-7263-59db-bbbd-a96a82d5699a/27088f32-7263-59db-bbbd-a96a82d5699a_image_7.jpg HTTP/1.1" 201 0
2025-12-04 10:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1506482-4007701-1003.jpg') HTTP/1.1" 204 0
2025-12-04 10:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1506482-4007701-1003.jpg saved to cache
2025-12-04 10:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 27088f32-7263-59db-bbbd-a96a82d5699a
2025-12-04 10:01:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 941069ff-ef30-5bba-82bd-388d3cb54f16 with identifier: 1966868
2025-12-04 10:01:54 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 941069ff-ef30-5bba-82bd-388d3cb54f16
2025-12-04 10:01:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02f86a59-5d45-5bc0-a6cd-8af80f1a5c13 with identifier: 2247450
2025-12-04 10:01:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02f86a59-5d45-5bc0-a6cd-8af80f1a5c13 with scrape type 1
2025-12-04 10:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 02f86a59-5d45-5bc0-a6cd-8af80f1a5c13
2025-12-04 10:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2247450-9999999-344103512-004.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2247450-9999999-344103512-004.jpg not downloaded yet
2025-12-04 10:01:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:01:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:01:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:01:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce64950>
2025-12-04 10:01:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:01:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:01:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27088f32-7263-59db-bbbd-a96a82d5699a/27088f32-7263-59db-bbbd-a96a82d5699a_image_9.jpg HTTP/1.1" 201 0
2025-12-04 10:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1506482-4007701-1005.jpg') HTTP/1.1" 204 0
2025-12-04 10:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1506482-4007701-1005.jpg saved to cache
2025-12-04 10:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 27088f32-7263-59db-bbbd-a96a82d5699a
2025-12-04 10:01:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 10:01:54 [manheim.gb] INFO: Found listing with ID: 3512799
2025-12-04 10:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273512799%27 HTTP/1.1" 200 None
2025-12-04 10:01:54 [manheim.gb] INFO: Scrape type for 3512799: 0
2025-12-04 10:01:54 [manheim.gb] INFO: Found listing with ID: 3516831
2025-12-04 10:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273516831%27 HTTP/1.1" 200 None
2025-12-04 10:01:54 [manheim.gb] INFO: Scrape type for 3516831: 0
2025-12-04 10:01:54 [manheim.gb] INFO: Found listing with ID: 3518224
2025-12-04 10:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273518224%27 HTTP/1.1" 200 None
2025-12-04 10:01:54 [manheim.gb] INFO: Scrape type for 3518224: 0
2025-12-04 10:01:54 [manheim.gb] INFO: Found listing with ID: 352448
2025-12-04 10:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27352448%27 HTTP/1.1" 200 None
2025-12-04 10:01:54 [manheim.gb] INFO: Scrape type for 352448: 0
2025-12-04 10:01:54 [manheim.gb] INFO: Found listing with ID: 3528421
2025-12-04 10:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273528421%27 HTTP/1.1" 200 None
2025-12-04 10:01:54 [manheim.gb] INFO: Scrape type for 3528421: 0
2025-12-04 10:01:54 [manheim.gb] INFO: Found listing with ID: 3542461
2025-12-04 10:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273542461%27 HTTP/1.1" 200 None
2025-12-04 10:01:54 [manheim.gb] INFO: Scrape type for 3542461: 0
2025-12-04 10:01:54 [manheim.gb] INFO: Found listing with ID: 3544627
2025-12-04 10:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273544627%27 HTTP/1.1" 200 None
2025-12-04 10:01:54 [manheim.gb] INFO: Scrape type for 3544627: 0
2025-12-04 10:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2247450-9999999-344103512-008.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2247450-9999999-344103512-008.jpg not downloaded yet
2025-12-04 10:01:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 10:01:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:01:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:01:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:01:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6e05d0>
2025-12-04 10:01:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:01:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:01:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27088f32-7263-59db-bbbd-a96a82d5699a/27088f32-7263-59db-bbbd-a96a82d5699a_image_10.jpg HTTP/1.1" 201 0
2025-12-04 10:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1506482-4007701-1006.jpg') HTTP/1.1" 204 0
2025-12-04 10:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1506482-4007701-1006.jpg saved to cache
2025-12-04 10:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 27088f32-7263-59db-bbbd-a96a82d5699a
2025-12-04 10:01:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 27088f32-7263-59db-bbbd-a96a82d5699a, skipping ID generation
2025-12-04 10:01:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27088f32-7263-59db-bbbd-a96a82d5699a with scrape type 1
2025-12-04 10:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 27088f32-7263-59db-bbbd-a96a82d5699a from tracking dictionaries
2025-12-04 10:01:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 27088f32-7263-59db-bbbd-a96a82d5699a sending to next pipeline
2025-12-04 10:01:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 27088f32-7263-59db-bbbd-a96a82d5699a, identifier: 1506482
2025-12-04 10:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2247450-9999999-344103512-001.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2247450-9999999-344103512-001.jpg not downloaded yet
2025-12-04 10:01:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 27088f32-7263-59db-bbbd-a96a82d5699a with identifier: 1506482
2025-12-04 10:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-04 10:01:55 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Red HTTP/1.1" 200 None
2025-12-04 10:01:55 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-04 10:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-04 10:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-04 10:01:55 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Petrol HTTP/1.1" 200 None
2025-12-04 10:01:55 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-04 10:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-04 10:01:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 27088f32-7263-59db-bbbd-a96a82d5699a with identifier: 1506482
2025-12-04 10:01:55 [scrapy.core.scraper] INFO: Dropped: Dropping expired listing: 27088f32-7263-59db-bbbd-a96a82d5699a with expiration date: 2025-12-04T09:00:00Z
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'car_expert_report_source_url': None,
 'color': 'Red',
 'currency': 'GBP',
 'engine': '1.0L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '27088f32-7263-59db-bbbd-a96a82d5699a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'BK15AAF',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/SKODA/CITIGO?id=1506482',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'SKODA',
 'model': 'CITIGO',
 'odometer': 105130,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 11,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4622c3ba-5515-5758-814e-2f49e4247fa1/4622c3ba-5515-5758-814e-2f49e4247fa1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72484,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/awaiting-image-002.jpg',
             'Width': 1322},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4622c3ba-5515-5758-814e-2f49e4247fa1/4622c3ba-5515-5758-814e-2f49e4247fa1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72484,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/awaiting-image-002.jpg',
             'Width': 1322},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27088f32-7263-59db-bbbd-a96a82d5699a/27088f32-7263-59db-bbbd-a96a82d5699a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 163968,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1506482-4007701-3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27088f32-7263-59db-bbbd-a96a82d5699a/27088f32-7263-59db-bbbd-a96a82d5699a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 281435,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1506482-4007701-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27088f32-7263-59db-bbbd-a96a82d5699a/27088f32-7263-59db-bbbd-a96a82d5699a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 177273,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1506482-4007701-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27088f32-7263-59db-bbbd-a96a82d5699a/27088f32-7263-59db-bbbd-a96a82d5699a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 169136,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1506482-4007701-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27088f32-7263-59db-bbbd-a96a82d5699a/27088f32-7263-59db-bbbd-a96a82d5699a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 148257,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1506482-4007701-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27088f32-7263-59db-bbbd-a96a82d5699a/27088f32-7263-59db-bbbd-a96a82d5699a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 402627,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1506482-4007701-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27088f32-7263-59db-bbbd-a96a82d5699a/27088f32-7263-59db-bbbd-a96a82d5699a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 252790,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1506482-4007701-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27088f32-7263-59db-bbbd-a96a82d5699a/27088f32-7263-59db-bbbd-a96a82d5699a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 179779,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1506482-4007701-1005.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27088f32-7263-59db-bbbd-a96a82d5699a/27088f32-7263-59db-bbbd-a96a82d5699a_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 155603,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1506482-4007701-1006.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-31',
 'seller_name': 'Big Motoring World Ltd',
 'title': 'SKODA CITIGO 1.0 MPI Monte Carlo 5dr',
 'transmission': 'manual',
 'trim': '1.0 MPI Monte Carlo 5dr',
 'year': 2015}
2025-12-04 10:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271506482%27 HTTP/1.1" 200 None
2025-12-04 10:01:55 [manheim.gb] INFO: Saving data for 1506482: {'created_time': 1764842515.602655, 'last_price_update_time': 1764842515.602669, 'auction_closing_time': 1764838800.0}
2025-12-04 10:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1506482') HTTP/1.1" 204 0
2025-12-04 10:01:55 [scrapy.core.engine] DEBUG: Crawled (404) <GET http://images.manheim.co.uk/images/units/zoom/2247450-9999999-344103512-004.jpg> (referer: None)
2025-12-04 10:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VOLVO/S90?id=2265358&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232265358&indx=107> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 10:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2247450-9999999-344103512-002.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2247450-9999999-344103512-002.jpg not downloaded yet
2025-12-04 10:01:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 10:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2247450-9999999-344103512-003.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2247450-9999999-344103512-003.jpg not downloaded yet
2025-12-04 10:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2247450-9999999-344103512-005.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2247450-9999999-344103512-005.jpg not downloaded yet
2025-12-04 10:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2247450-9999999-344103512-006.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2247450-9999999-344103512-006.jpg not downloaded yet
2025-12-04 10:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2247450-9999999-344103512-007.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2247450-9999999-344103512-007.jpg not downloaded yet
2025-12-04 10:01:55 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 02f86a59-5d45-5bc0-a6cd-8af80f1a5c13 due to Ignoring non-200 response
2025-12-04 10:01:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b102101-564b-564d-8986-4da408ea4b0f with identifier: 2265358
2025-12-04 10:01:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b102101-564b-564d-8986-4da408ea4b0f with scrape type 1
2025-12-04 10:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 5b102101-564b-564d-8986-4da408ea4b0f
2025-12-04 10:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fawaiting-image-002.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/awaiting-image-002.jpg already downloaded
2025-12-04 10:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fawaiting-image-002.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/awaiting-image-002.jpg already downloaded
2025-12-04 10:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2265358-4007656-3.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2265358-4007656-3.jpg not downloaded yet
2025-12-04 10:01:56 [scrapy.core.engine] DEBUG: Crawled (404) <GET http://images.manheim.co.uk/images/units/zoom/2247450-9999999-344103512-008.jpg> (referer: None)
2025-12-04 10:01:56 [scrapy.core.engine] DEBUG: Crawled (404) <GET http://images.manheim.co.uk/images/units/zoom/2247450-9999999-344103512-001.jpg> (referer: None)
2025-12-04 10:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2247450-9999999-344103512-009.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2247450-9999999-344103512-009.jpg not downloaded yet
2025-12-04 10:01:56 [scrapy.core.engine] DEBUG: Crawled (404) <GET http://images.manheim.co.uk/images/units/zoom/2247450-9999999-344103512-002.jpg> (referer: None)
2025-12-04 10:01:56 [scrapy.core.engine] DEBUG: Crawled (404) <GET http://images.manheim.co.uk/images/units/zoom/2247450-9999999-344103512-003.jpg> (referer: None)
2025-12-04 10:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2265358-4007656-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2265358-4007656-13.jpg not downloaded yet
2025-12-04 10:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2247450-9999999-344103512-010.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2247450-9999999-344103512-010.jpg not downloaded yet
2025-12-04 10:01:56 [scrapy.core.engine] DEBUG: Crawled (404) <GET http://images.manheim.co.uk/images/units/zoom/2247450-9999999-344103512-005.jpg> (referer: None)
2025-12-04 10:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2265358-4007656-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2265358-4007656-1000.jpg not downloaded yet
2025-12-04 10:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2247450-9999999-344103512-011.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2247450-9999999-344103512-011.jpg not downloaded yet
2025-12-04 10:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2265358-4007656-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2265358-4007656-1001.jpg not downloaded yet
2025-12-04 10:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2247450-9999999-344103512-012.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2247450-9999999-344103512-012.jpg not downloaded yet
2025-12-04 10:01:56 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 02f86a59-5d45-5bc0-a6cd-8af80f1a5c13 due to Ignoring non-200 response
2025-12-04 10:01:56 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 02f86a59-5d45-5bc0-a6cd-8af80f1a5c13 due to Ignoring non-200 response
2025-12-04 10:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2265358-4007656-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2265358-4007656-1002.jpg not downloaded yet
2025-12-04 10:01:56 [scrapy.core.engine] DEBUG: Crawled (404) <GET http://images.manheim.co.uk/images/units/zoom/2247450-9999999-344103512-007.jpg> (referer: None)
2025-12-04 10:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2247450-4007658-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2247450-4007658-13.jpg not downloaded yet
2025-12-04 10:01:56 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 02f86a59-5d45-5bc0-a6cd-8af80f1a5c13 due to Ignoring non-200 response
2025-12-04 10:01:56 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 02f86a59-5d45-5bc0-a6cd-8af80f1a5c13 due to Ignoring non-200 response
2025-12-04 10:01:56 [scrapy.core.engine] DEBUG: Crawled (404) <GET http://images.manheim.co.uk/images/units/zoom/2247450-9999999-344103512-006.jpg> (referer: None)
2025-12-04 10:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2265358-4007656-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2265358-4007656-1003.jpg not downloaded yet
2025-12-04 10:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2247450-4007658-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2247450-4007658-1000.jpg not downloaded yet
2025-12-04 10:01:56 [scrapy.core.engine] DEBUG: Crawled (404) <GET http://images.manheim.co.uk/images/units/zoom/2247450-9999999-344103512-009.jpg> (referer: None)
2025-12-04 10:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2265358-4007656-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2265358-4007656-1004.jpg not downloaded yet
2025-12-04 10:01:56 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 02f86a59-5d45-5bc0-a6cd-8af80f1a5c13 due to Ignoring non-200 response
2025-12-04 10:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2265358-4007656-3.jpg> (referer: None)
2025-12-04 10:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2247450-4007658-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2247450-4007658-1001.jpg not downloaded yet
2025-12-04 10:01:56 [scrapy.core.engine] DEBUG: Crawled (404) <GET http://images.manheim.co.uk/images/units/zoom/2247450-9999999-344103512-010.jpg> (referer: None)
2025-12-04 10:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0001761741-01991419-003.pdf> (referer: None)
2025-12-04 10:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0001564179-01991001-001.pdf> (referer: None)
2025-12-04 10:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2247450-4007658-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2247450-4007658-1002.jpg not downloaded yet
2025-12-04 10:01:56 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 02f86a59-5d45-5bc0-a6cd-8af80f1a5c13 due to Ignoring non-200 response
2025-12-04 10:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2247450-4007658-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2247450-4007658-1003.jpg not downloaded yet
2025-12-04 10:01:56 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 02f86a59-5d45-5bc0-a6cd-8af80f1a5c13 due to Ignoring non-200 response
2025-12-04 10:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2247450-4007658-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2247450-4007658-1004.jpg not downloaded yet
2025-12-04 10:01:56 [scrapy.core.engine] DEBUG: Crawled (404) <GET http://images.manheim.co.uk/images/units/zoom/2247450-9999999-344103512-012.jpg> (referer: None)
2025-12-04 10:01:56 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 02f86a59-5d45-5bc0-a6cd-8af80f1a5c13 due to Ignoring non-200 response
2025-12-04 10:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2247450-4007658-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2247450-4007658-1005.jpg not downloaded yet
2025-12-04 10:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2247450-4007658-1006.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2247450-4007658-1006.jpg not downloaded yet
2025-12-04 10:01:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:01:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5726d0>
2025-12-04 10:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:01:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b102101-564b-564d-8986-4da408ea4b0f/5b102101-564b-564d-8986-4da408ea4b0f_image_2.jpg HTTP/1.1" 201 0
2025-12-04 10:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2265358-4007656-3.jpg') HTTP/1.1" 204 0
2025-12-04 10:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2265358-4007656-3.jpg saved to cache
2025-12-04 10:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5b102101-564b-564d-8986-4da408ea4b0f
2025-12-04 10:01:56 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 02f86a59-5d45-5bc0-a6cd-8af80f1a5c13 due to Ignoring non-200 response
2025-12-04 10:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2247450-4007658-1000.jpg> (referer: None)
2025-12-04 10:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2265358-4007656-1003.jpg> (referer: None)
2025-12-04 10:01:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:01:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf69690>
2025-12-04 10:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:01:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08d45d44-06c8-5777-ab82-d212449d4408/08d45d44-06c8-5777-ab82-d212449d4408_expert_report_file_a230b9e9-76af-4837-9451-581cd87af006.pdf HTTP/1.1" 201 0
2025-12-04 10:01:57 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 08d45d44-06c8-5777-ab82-d212449d4408
2025-12-04 10:01:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 08d45d44-06c8-5777-ab82-d212449d4408, skipping ID generation
2025-12-04 10:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 08d45d44-06c8-5777-ab82-d212449d4408
2025-12-04 10:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F936490aa-3134-4728-b2c9-3885f9adf43f_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/936490aa-3134-4728-b2c9-3885f9adf43f_ext_7.jpg not downloaded yet
2025-12-04 10:01:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:01:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc56e7d0>
2025-12-04 10:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:01:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9200c31a-aec5-5dca-8036-0876fcfb70f2/9200c31a-aec5-5dca-8036-0876fcfb70f2_expert_report_file_45baa790-0d2d-4f2b-bc40-21212933f239.pdf HTTP/1.1" 201 0
2025-12-04 10:01:57 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 9200c31a-aec5-5dca-8036-0876fcfb70f2
2025-12-04 10:01:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9200c31a-aec5-5dca-8036-0876fcfb70f2, skipping ID generation
2025-12-04 10:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 9200c31a-aec5-5dca-8036-0876fcfb70f2
2025-12-04 10:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4a84e7fd-e03b-494b-af2a-02ac1b2a19e4_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4a84e7fd-e03b-494b-af2a-02ac1b2a19e4_ext_7.jpg not downloaded yet
2025-12-04 10:01:57 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 11 for item 02f86a59-5d45-5bc0-a6cd-8af80f1a5c13 due to Ignoring non-200 response
2025-12-04 10:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2265358-4007656-1002.jpg> (referer: None)
2025-12-04 10:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F936490aa-3134-4728-b2c9-3885f9adf43f_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/936490aa-3134-4728-b2c9-3885f9adf43f_ext_7.jpg not downloaded yet
2025-12-04 10:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4a84e7fd-e03b-494b-af2a-02ac1b2a19e4_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4a84e7fd-e03b-494b-af2a-02ac1b2a19e4_ext_7.jpg not downloaded yet
2025-12-04 10:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F936490aa-3134-4728-b2c9-3885f9adf43f_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/936490aa-3134-4728-b2c9-3885f9adf43f_ext_6.jpg not downloaded yet
2025-12-04 10:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4a84e7fd-e03b-494b-af2a-02ac1b2a19e4_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4a84e7fd-e03b-494b-af2a-02ac1b2a19e4_ext_6.jpg not downloaded yet
2025-12-04 10:01:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:01:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ce7f9810>
2025-12-04 10:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:01:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02f86a59-5d45-5bc0-a6cd-8af80f1a5c13/02f86a59-5d45-5bc0-a6cd-8af80f1a5c13_image_13.jpg HTTP/1.1" 201 0
2025-12-04 10:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2247450-4007658-1000.jpg') HTTP/1.1" 204 0
2025-12-04 10:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2247450-4007658-1000.jpg saved to cache
2025-12-04 10:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 02f86a59-5d45-5bc0-a6cd-8af80f1a5c13
2025-12-04 10:01:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:01:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:01:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:01:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccfc3850>
2025-12-04 10:01:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:01:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b102101-564b-564d-8986-4da408ea4b0f/5b102101-564b-564d-8986-4da408ea4b0f_image_7.jpg HTTP/1.1" 201 0
2025-12-04 10:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2265358-4007656-1003.jpg') HTTP/1.1" 204 0
2025-12-04 10:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2265358-4007656-1003.jpg saved to cache
2025-12-04 10:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5b102101-564b-564d-8986-4da408ea4b0f
2025-12-04 10:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F936490aa-3134-4728-b2c9-3885f9adf43f_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/936490aa-3134-4728-b2c9-3885f9adf43f_ext_1.jpg not downloaded yet
2025-12-04 10:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4a84e7fd-e03b-494b-af2a-02ac1b2a19e4_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4a84e7fd-e03b-494b-af2a-02ac1b2a19e4_ext_1.jpg not downloaded yet
2025-12-04 10:01:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:01:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:01:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:01:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd107450>
2025-12-04 10:01:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:01:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b102101-564b-564d-8986-4da408ea4b0f/5b102101-564b-564d-8986-4da408ea4b0f_image_6.jpg HTTP/1.1" 201 0
2025-12-04 10:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2265358-4007656-1002.jpg') HTTP/1.1" 204 0
2025-12-04 10:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2265358-4007656-1002.jpg saved to cache
2025-12-04 10:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5b102101-564b-564d-8986-4da408ea4b0f
2025-12-04 10:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F936490aa-3134-4728-b2c9-3885f9adf43f_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/936490aa-3134-4728-b2c9-3885f9adf43f_5.jpg not downloaded yet
2025-12-04 10:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4a84e7fd-e03b-494b-af2a-02ac1b2a19e4_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4a84e7fd-e03b-494b-af2a-02ac1b2a19e4_5.jpg not downloaded yet
2025-12-04 10:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F936490aa-3134-4728-b2c9-3885f9adf43f_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/936490aa-3134-4728-b2c9-3885f9adf43f_4.jpg not downloaded yet
2025-12-04 10:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4a84e7fd-e03b-494b-af2a-02ac1b2a19e4_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4a84e7fd-e03b-494b-af2a-02ac1b2a19e4_4.jpg not downloaded yet
2025-12-04 10:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/refine> (referer: https://www.manheim.co.uk/search) ['zyte-api']
2025-12-04 10:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F936490aa-3134-4728-b2c9-3885f9adf43f_11.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/936490aa-3134-4728-b2c9-3885f9adf43f_11.jpg not downloaded yet
2025-12-04 10:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4a84e7fd-e03b-494b-af2a-02ac1b2a19e4_11.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4a84e7fd-e03b-494b-af2a-02ac1b2a19e4_11.jpg not downloaded yet
2025-12-04 10:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=233754&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%23233754&indx=118> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 10:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F936490aa-3134-4728-b2c9-3885f9adf43f_10.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/936490aa-3134-4728-b2c9-3885f9adf43f_10.jpg not downloaded yet
2025-12-04 10:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4a84e7fd-e03b-494b-af2a-02ac1b2a19e4_10.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4a84e7fd-e03b-494b-af2a-02ac1b2a19e4_10.jpg not downloaded yet
2025-12-04 10:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F936490aa-3134-4728-b2c9-3885f9adf43f_9.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/936490aa-3134-4728-b2c9-3885f9adf43f_9.jpg not downloaded yet
2025-12-04 10:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4a84e7fd-e03b-494b-af2a-02ac1b2a19e4_9.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4a84e7fd-e03b-494b-af2a-02ac1b2a19e4_9.jpg not downloaded yet
2025-12-04 10:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F936490aa-3134-4728-b2c9-3885f9adf43f_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/936490aa-3134-4728-b2c9-3885f9adf43f_ext_2.jpg not downloaded yet
2025-12-04 10:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4a84e7fd-e03b-494b-af2a-02ac1b2a19e4_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4a84e7fd-e03b-494b-af2a-02ac1b2a19e4_ext_2.jpg not downloaded yet
2025-12-04 10:01:59 [manheim.gb] INFO: Found listing with ID: 3553764
2025-12-04 10:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273553764%27 HTTP/1.1" 200 None
2025-12-04 10:01:59 [manheim.gb] INFO: Scrape type for 3553764: 0
2025-12-04 10:01:59 [manheim.gb] INFO: Found listing with ID: 3566423
2025-12-04 10:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273566423%27 HTTP/1.1" 200 None
2025-12-04 10:01:59 [manheim.gb] INFO: Scrape type for 3566423: 0
2025-12-04 10:01:59 [manheim.gb] INFO: Found listing with ID: 3571047
2025-12-04 10:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273571047%27 HTTP/1.1" 200 None
2025-12-04 10:01:59 [manheim.gb] INFO: Scrape type for 3571047: 1
2025-12-04 10:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F936490aa-3134-4728-b2c9-3885f9adf43f_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/936490aa-3134-4728-b2c9-3885f9adf43f_ext_5.jpg not downloaded yet
2025-12-04 10:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4a84e7fd-e03b-494b-af2a-02ac1b2a19e4_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4a84e7fd-e03b-494b-af2a-02ac1b2a19e4_ext_5.jpg not downloaded yet
2025-12-04 10:01:59 [manheim.gb] INFO: Found listing with ID: 3583550
2025-12-04 10:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273583550%27 HTTP/1.1" 200 None
2025-12-04 10:01:59 [manheim.gb] INFO: Scrape type for 3583550: 1
2025-12-04 10:01:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d428e59-cadd-5753-a5bf-34918c220e1e with identifier: 233754
2025-12-04 10:01:59 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 8d428e59-cadd-5753-a5bf-34918c220e1e
2025-12-04 10:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F936490aa-3134-4728-b2c9-3885f9adf43f_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/936490aa-3134-4728-b2c9-3885f9adf43f_ext_3.jpg not downloaded yet
2025-12-04 10:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4a84e7fd-e03b-494b-af2a-02ac1b2a19e4_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4a84e7fd-e03b-494b-af2a-02ac1b2a19e4_ext_3.jpg not downloaded yet
2025-12-04 10:01:59 [manheim.gb] INFO: Found listing with ID: 3586152
2025-12-04 10:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273586152%27 HTTP/1.1" 200 None
2025-12-04 10:01:59 [manheim.gb] INFO: Scrape type for 3586152: 1
2025-12-04 10:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0001966868-01991002-001.pdf> (referer: None)
2025-12-04 10:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F936490aa-3134-4728-b2c9-3885f9adf43f_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/936490aa-3134-4728-b2c9-3885f9adf43f_ext_4.jpg not downloaded yet
2025-12-04 10:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4a84e7fd-e03b-494b-af2a-02ac1b2a19e4_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4a84e7fd-e03b-494b-af2a-02ac1b2a19e4_ext_4.jpg not downloaded yet
2025-12-04 10:01:59 [manheim.gb] INFO: Found listing with ID: 358707
2025-12-04 10:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27358707%27 HTTP/1.1" 200 None
2025-12-04 10:01:59 [manheim.gb] INFO: Scrape type for 358707: 1
2025-12-04 10:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1761741-4007528-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1761741-4007528-13.jpg not downloaded yet
2025-12-04 10:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1564179-4007572-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1564179-4007572-13.jpg not downloaded yet
2025-12-04 10:01:59 [manheim.gb] INFO: Found listing with ID: 3591726
2025-12-04 10:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273591726%27 HTTP/1.1" 200 None
2025-12-04 10:01:59 [manheim.gb] INFO: Scrape type for 3591726: 1
2025-12-04 10:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1761741-4007528-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1761741-4007528-1000.jpg not downloaded yet
2025-12-04 10:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1564179-4007572-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1564179-4007572-1000.jpg not downloaded yet
2025-12-04 10:01:59 [manheim.gb] INFO: Found listing with ID: 3595741
2025-12-04 10:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273595741%27 HTTP/1.1" 200 None
2025-12-04 10:01:59 [manheim.gb] INFO: Scrape type for 3595741: 1
2025-12-04 10:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1761741-4007528-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1761741-4007528-1001.jpg not downloaded yet
2025-12-04 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1564179-4007572-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1564179-4007572-1001.jpg not downloaded yet
2025-12-04 10:02:00 [manheim.gb] INFO: Found listing with ID: 3603120
2025-12-04 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273603120%27 HTTP/1.1" 200 None
2025-12-04 10:02:00 [manheim.gb] INFO: Scrape type for 3603120: 1
2025-12-04 10:02:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccfcfd50>
2025-12-04 10:02:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_941069ff-ef30-5bba-82bd-388d3cb54f16/941069ff-ef30-5bba-82bd-388d3cb54f16_expert_report_file_353096cd-c885-40fb-9c4a-6e4cd62b281f.pdf HTTP/1.1" 201 0
2025-12-04 10:02:00 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 941069ff-ef30-5bba-82bd-388d3cb54f16
2025-12-04 10:02:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 941069ff-ef30-5bba-82bd-388d3cb54f16, skipping ID generation
2025-12-04 10:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 941069ff-ef30-5bba-82bd-388d3cb54f16
2025-12-04 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F79d3f9d2-f35f-4d29-ae30-54140900dd77_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/79d3f9d2-f35f-4d29-ae30-54140900dd77_ext_7.jpg not downloaded yet
2025-12-04 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1761741-4007528-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1761741-4007528-1002.jpg not downloaded yet
2025-12-04 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1564179-4007572-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1564179-4007572-1002.jpg not downloaded yet
2025-12-04 10:02:00 [manheim.gb] INFO: Found listing with ID: 3612695
2025-12-04 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273612695%27 HTTP/1.1" 200 None
2025-12-04 10:02:00 [manheim.gb] INFO: Scrape type for 3612695: 1
2025-12-04 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F79d3f9d2-f35f-4d29-ae30-54140900dd77_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/79d3f9d2-f35f-4d29-ae30-54140900dd77_ext_7.jpg not downloaded yet
2025-12-04 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1761741-4007528-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1761741-4007528-1003.jpg not downloaded yet
2025-12-04 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1564179-4007572-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1564179-4007572-1003.jpg not downloaded yet
2025-12-04 10:02:00 [manheim.gb] INFO: Found listing with ID: 3613252
2025-12-04 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273613252%27 HTTP/1.1" 200 None
2025-12-04 10:02:00 [manheim.gb] INFO: Scrape type for 3613252: 1
2025-12-04 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F79d3f9d2-f35f-4d29-ae30-54140900dd77_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/79d3f9d2-f35f-4d29-ae30-54140900dd77_ext_6.jpg not downloaded yet
2025-12-04 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1761741-4007528-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1761741-4007528-1004.jpg not downloaded yet
2025-12-04 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1564179-4007572-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1564179-4007572-1004.jpg not downloaded yet
2025-12-04 10:02:00 [manheim.gb] INFO: Found listing with ID: 3616829
2025-12-04 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273616829%27 HTTP/1.1" 200 None
2025-12-04 10:02:00 [manheim.gb] INFO: Scrape type for 3616829: 1
2025-12-04 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F79d3f9d2-f35f-4d29-ae30-54140900dd77_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/79d3f9d2-f35f-4d29-ae30-54140900dd77_ext_1.jpg not downloaded yet
2025-12-04 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1761741-4007528-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1761741-4007528-1005.jpg not downloaded yet
2025-12-04 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1564179-4007572-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1564179-4007572-1005.jpg not downloaded yet
2025-12-04 10:02:00 [manheim.gb] INFO: Found listing with ID: 3619601
2025-12-04 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273619601%27 HTTP/1.1" 200 None
2025-12-04 10:02:00 [manheim.gb] INFO: Scrape type for 3619601: 1
2025-12-04 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F79d3f9d2-f35f-4d29-ae30-54140900dd77_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/79d3f9d2-f35f-4d29-ae30-54140900dd77_5.jpg not downloaded yet
2025-12-04 10:02:00 [manheim.gb] INFO: Found listing with ID: 3622853
2025-12-04 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273622853%27 HTTP/1.1" 200 None
2025-12-04 10:02:00 [manheim.gb] INFO: Scrape type for 3622853: 1
2025-12-04 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F79d3f9d2-f35f-4d29-ae30-54140900dd77_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/79d3f9d2-f35f-4d29-ae30-54140900dd77_4.jpg not downloaded yet
2025-12-04 10:02:00 [manheim.gb] INFO: Found listing with ID: 3622898
2025-12-04 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273622898%27 HTTP/1.1" 200 None
2025-12-04 10:02:00 [manheim.gb] INFO: Scrape type for 3622898: 1
2025-12-04 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F79d3f9d2-f35f-4d29-ae30-54140900dd77_11.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/79d3f9d2-f35f-4d29-ae30-54140900dd77_11.jpg not downloaded yet
2025-12-04 10:02:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 10:02:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 10:02:00 [manheim.gb] INFO: Found listing with ID: 363011
2025-12-04 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27363011%27 HTTP/1.1" 200 None
2025-12-04 10:02:00 [manheim.gb] INFO: Scrape type for 363011: 1
2025-12-04 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F79d3f9d2-f35f-4d29-ae30-54140900dd77_10.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/79d3f9d2-f35f-4d29-ae30-54140900dd77_10.jpg not downloaded yet
2025-12-04 10:02:00 [manheim.gb] INFO: Found listing with ID: 3630205
2025-12-04 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273630205%27 HTTP/1.1" 200 None
2025-12-04 10:02:00 [manheim.gb] INFO: Scrape type for 3630205: 1
2025-12-04 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F79d3f9d2-f35f-4d29-ae30-54140900dd77_9.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/79d3f9d2-f35f-4d29-ae30-54140900dd77_9.jpg not downloaded yet
2025-12-04 10:02:00 [manheim.gb] INFO: Found listing with ID: 3633295
2025-12-04 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273633295%27 HTTP/1.1" 200 None
2025-12-04 10:02:00 [manheim.gb] INFO: Scrape type for 3633295: 1
2025-12-04 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F79d3f9d2-f35f-4d29-ae30-54140900dd77_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/79d3f9d2-f35f-4d29-ae30-54140900dd77_ext_2.jpg not downloaded yet
2025-12-04 10:02:00 [manheim.gb] INFO: Found listing with ID: 3634767
2025-12-04 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273634767%27 HTTP/1.1" 200 None
2025-12-04 10:02:01 [manheim.gb] INFO: Scrape type for 3634767: 1
2025-12-04 10:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F79d3f9d2-f35f-4d29-ae30-54140900dd77_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/79d3f9d2-f35f-4d29-ae30-54140900dd77_ext_5.jpg not downloaded yet
2025-12-04 10:02:01 [manheim.gb] INFO: Found listing with ID: 3636928
2025-12-04 10:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273636928%27 HTTP/1.1" 200 None
2025-12-04 10:02:01 [manheim.gb] INFO: Scrape type for 3636928: 1
2025-12-04 10:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F79d3f9d2-f35f-4d29-ae30-54140900dd77_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/79d3f9d2-f35f-4d29-ae30-54140900dd77_ext_3.jpg not downloaded yet
2025-12-04 10:02:01 [manheim.gb] INFO: Found listing with ID: 3637795
2025-12-04 10:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273637795%27 HTTP/1.1" 200 None
2025-12-04 10:02:01 [manheim.gb] INFO: Scrape type for 3637795: 1
2025-12-04 10:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/79d3f9d2-f35f-4d29-ae30-54140900dd77_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001966868-01991002-001.pdf)
2025-12-04 10:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F79d3f9d2-f35f-4d29-ae30-54140900dd77_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/79d3f9d2-f35f-4d29-ae30-54140900dd77_ext_4.jpg not downloaded yet
2025-12-04 10:02:01 [manheim.gb] INFO: Found listing with ID: 3655657
2025-12-04 10:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273655657%27 HTTP/1.1" 200 None
2025-12-04 10:02:01 [manheim.gb] INFO: Scrape type for 3655657: 1
2025-12-04 10:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1966868-4007672-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1966868-4007672-13.jpg not downloaded yet
2025-12-04 10:02:01 [manheim.gb] INFO: Found listing with ID: 3657400
2025-12-04 10:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273657400%27 HTTP/1.1" 200 None
2025-12-04 10:02:01 [manheim.gb] INFO: Scrape type for 3657400: 1
2025-12-04 10:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1564179-4007572-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001564179-01991001-001.pdf)
2025-12-04 10:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/79d3f9d2-f35f-4d29-ae30-54140900dd77_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001966868-01991002-001.pdf)
2025-12-04 10:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1966868-4007672-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1966868-4007672-1000.jpg not downloaded yet
2025-12-04 10:02:01 [manheim.gb] INFO: Found listing with ID: 3663676
2025-12-04 10:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273663676%27 HTTP/1.1" 200 None
2025-12-04 10:02:01 [manheim.gb] INFO: Scrape type for 3663676: 1
2025-12-04 10:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1966868-4007672-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1966868-4007672-1001.jpg not downloaded yet
2025-12-04 10:02:01 [manheim.gb] INFO: Found listing with ID: 3665401
2025-12-04 10:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273665401%27 HTTP/1.1" 200 None
2025-12-04 10:02:01 [manheim.gb] INFO: Scrape type for 3665401: 0
2025-12-04 10:02:01 [manheim.gb] INFO: Found listing with ID: 3667925
2025-12-04 10:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273667925%27 HTTP/1.1" 200 None
2025-12-04 10:02:01 [manheim.gb] INFO: Scrape type for 3667925: 1
2025-12-04 10:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1761741-4007528-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001761741-01991419-003.pdf)
2025-12-04 10:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1966868-4007672-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1966868-4007672-1002.jpg not downloaded yet
2025-12-04 10:02:01 [manheim.gb] INFO: Found listing with ID: 3669473
2025-12-04 10:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273669473%27 HTTP/1.1" 200 None
2025-12-04 10:02:01 [manheim.gb] INFO: Scrape type for 3669473: 0
2025-12-04 10:02:01 [manheim.gb] INFO: Found listing with ID: 3677202
2025-12-04 10:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273677202%27 HTTP/1.1" 200 None
2025-12-04 10:02:01 [manheim.gb] INFO: Scrape type for 3677202: 1
2025-12-04 10:02:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf9fcd0>
2025-12-04 10:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_941069ff-ef30-5bba-82bd-388d3cb54f16/941069ff-ef30-5bba-82bd-388d3cb54f16_image_3.jpg HTTP/1.1" 201 0
2025-12-04 10:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F79d3f9d2-f35f-4d29-ae30-54140900dd77_ext_1.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/79d3f9d2-f35f-4d29-ae30-54140900dd77_ext_1.jpg saved to cache
2025-12-04 10:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 941069ff-ef30-5bba-82bd-388d3cb54f16
2025-12-04 10:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1966868-4007672-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1966868-4007672-1003.jpg not downloaded yet
2025-12-04 10:02:01 [manheim.gb] INFO: Found listing with ID: 3678294
2025-12-04 10:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273678294%27 HTTP/1.1" 200 None
2025-12-04 10:02:01 [manheim.gb] INFO: Scrape type for 3678294: 1
2025-12-04 10:02:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccfafd90>
2025-12-04 10:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9200c31a-aec5-5dca-8036-0876fcfb70f2/9200c31a-aec5-5dca-8036-0876fcfb70f2_image_19.jpg HTTP/1.1" 201 0
2025-12-04 10:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1564179-4007572-1005.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1564179-4007572-1005.jpg saved to cache
2025-12-04 10:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 9200c31a-aec5-5dca-8036-0876fcfb70f2
2025-12-04 10:02:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd11f990>
2025-12-04 10:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_941069ff-ef30-5bba-82bd-388d3cb54f16/941069ff-ef30-5bba-82bd-388d3cb54f16_image_5.jpg HTTP/1.1" 201 0
2025-12-04 10:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F79d3f9d2-f35f-4d29-ae30-54140900dd77_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/79d3f9d2-f35f-4d29-ae30-54140900dd77_4.jpg saved to cache
2025-12-04 10:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 941069ff-ef30-5bba-82bd-388d3cb54f16
2025-12-04 10:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1966868-4007672-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1966868-4007672-1004.jpg not downloaded yet
2025-12-04 10:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/79d3f9d2-f35f-4d29-ae30-54140900dd77_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001966868-01991002-001.pdf)
2025-12-04 10:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1564179-4007572-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001564179-01991001-001.pdf)
2025-12-04 10:02:02 [manheim.gb] INFO: Found listing with ID: 3682181
2025-12-04 10:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273682181%27 HTTP/1.1" 200 None
2025-12-04 10:02:02 [manheim.gb] INFO: Scrape type for 3682181: 1
2025-12-04 10:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1966868-4007672-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001966868-01991002-001.pdf)
2025-12-04 10:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1966868-4007672-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1966868-4007672-1005.jpg not downloaded yet
2025-12-04 10:02:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce86590>
2025-12-04 10:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08d45d44-06c8-5777-ab82-d212449d4408/08d45d44-06c8-5777-ab82-d212449d4408_image_19.jpg HTTP/1.1" 201 0
2025-12-04 10:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1761741-4007528-1005.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1761741-4007528-1005.jpg saved to cache
2025-12-04 10:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 08d45d44-06c8-5777-ab82-d212449d4408
2025-12-04 10:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1761741-4007528-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001761741-01991419-003.pdf)
2025-12-04 10:02:02 [manheim.gb] INFO: Found listing with ID: 3684881
2025-12-04 10:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273684881%27 HTTP/1.1" 200 None
2025-12-04 10:02:02 [manheim.gb] INFO: Scrape type for 3684881: 1
2025-12-04 10:02:02 [manheim.gb] INFO: Found listing with ID: 3684907
2025-12-04 10:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273684907%27 HTTP/1.1" 200 None
2025-12-04 10:02:02 [manheim.gb] INFO: Scrape type for 3684907: 1
2025-12-04 10:02:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6ce250>
2025-12-04 10:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 10:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_941069ff-ef30-5bba-82bd-388d3cb54f16/941069ff-ef30-5bba-82bd-388d3cb54f16_image_4.jpg HTTP/1.1" 201 0
2025-12-04 10:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F79d3f9d2-f35f-4d29-ae30-54140900dd77_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/79d3f9d2-f35f-4d29-ae30-54140900dd77_5.jpg saved to cache
2025-12-04 10:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 941069ff-ef30-5bba-82bd-388d3cb54f16
2025-12-04 10:02:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd1de50>
2025-12-04 10:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9200c31a-aec5-5dca-8036-0876fcfb70f2/9200c31a-aec5-5dca-8036-0876fcfb70f2_image_18.jpg HTTP/1.1" 201 0
2025-12-04 10:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1564179-4007572-1004.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1564179-4007572-1004.jpg saved to cache
2025-12-04 10:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 9200c31a-aec5-5dca-8036-0876fcfb70f2
2025-12-04 10:02:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc725310>
2025-12-04 10:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_941069ff-ef30-5bba-82bd-388d3cb54f16/941069ff-ef30-5bba-82bd-388d3cb54f16_image_13.jpg HTTP/1.1" 201 0
2025-12-04 10:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1966868-4007672-13.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1966868-4007672-13.jpg saved to cache
2025-12-04 10:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 941069ff-ef30-5bba-82bd-388d3cb54f16
2025-12-04 10:02:03 [manheim.gb] INFO: Found listing with ID: 3684908
2025-12-04 10:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273684908%27 HTTP/1.1" 200 None
2025-12-04 10:02:03 [manheim.gb] INFO: Scrape type for 3684908: 1
2025-12-04 10:02:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cccec7d0>
2025-12-04 10:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08d45d44-06c8-5777-ab82-d212449d4408/08d45d44-06c8-5777-ab82-d212449d4408_image_18.jpg HTTP/1.1" 201 0
2025-12-04 10:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1761741-4007528-1004.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1761741-4007528-1004.jpg saved to cache
2025-12-04 10:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 08d45d44-06c8-5777-ab82-d212449d4408
2025-12-04 10:02:04 [manheim.gb] INFO: Found listing with ID: 3691518
2025-12-04 10:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273691518%27 HTTP/1.1" 200 None
2025-12-04 10:02:04 [manheim.gb] INFO: Scrape type for 3691518: 1
2025-12-04 10:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1966868-4007672-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001966868-01991002-001.pdf)
2025-12-04 10:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1966868-4007672-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001966868-01991002-001.pdf)
2025-12-04 10:02:04 [manheim.gb] INFO: Found listing with ID: 3692062
2025-12-04 10:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273692062%27 HTTP/1.1" 200 None
2025-12-04 10:02:04 [manheim.gb] INFO: Scrape type for 3692062: 1
2025-12-04 10:02:04 [manheim.gb] INFO: Found listing with ID: 3693298
2025-12-04 10:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273693298%27 HTTP/1.1" 200 None
2025-12-04 10:02:04 [manheim.gb] INFO: Scrape type for 3693298: 1
2025-12-04 10:02:04 [manheim.gb] INFO: Found listing with ID: 3694568
2025-12-04 10:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273694568%27 HTTP/1.1" 200 None
2025-12-04 10:02:04 [manheim.gb] INFO: Scrape type for 3694568: 1
2025-12-04 10:02:04 [manheim.gb] INFO: Found listing with ID: 3695980
2025-12-04 10:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273695980%27 HTTP/1.1" 200 None
2025-12-04 10:02:04 [manheim.gb] INFO: Scrape type for 3695980: 1
2025-12-04 10:02:04 [manheim.gb] INFO: Found listing with ID: 3696200
2025-12-04 10:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273696200%27 HTTP/1.1" 200 None
2025-12-04 10:02:04 [manheim.gb] INFO: Scrape type for 3696200: 1
2025-12-04 10:02:04 [manheim.gb] INFO: Found listing with ID: 3696287
2025-12-04 10:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273696287%27 HTTP/1.1" 200 None
2025-12-04 10:02:04 [manheim.gb] INFO: Scrape type for 3696287: 1
2025-12-04 10:02:04 [manheim.gb] INFO: Found listing with ID: 3696571
2025-12-04 10:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273696571%27 HTTP/1.1" 200 None
2025-12-04 10:02:04 [manheim.gb] INFO: Scrape type for 3696571: 1
2025-12-04 10:02:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6fd9d0>
2025-12-04 10:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_941069ff-ef30-5bba-82bd-388d3cb54f16/941069ff-ef30-5bba-82bd-388d3cb54f16_image_17.jpg HTTP/1.1" 201 0
2025-12-04 10:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1966868-4007672-1003.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1966868-4007672-1003.jpg saved to cache
2025-12-04 10:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 941069ff-ef30-5bba-82bd-388d3cb54f16
2025-12-04 10:02:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc544450>
2025-12-04 10:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_941069ff-ef30-5bba-82bd-388d3cb54f16/941069ff-ef30-5bba-82bd-388d3cb54f16_image_18.jpg HTTP/1.1" 201 0
2025-12-04 10:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1966868-4007672-1004.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1966868-4007672-1004.jpg saved to cache
2025-12-04 10:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 941069ff-ef30-5bba-82bd-388d3cb54f16
2025-12-04 10:02:04 [manheim.gb] INFO: Found listing with ID: 3708538
2025-12-04 10:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273708538%27 HTTP/1.1" 200 None
2025-12-04 10:02:04 [manheim.gb] INFO: Scrape type for 3708538: 1
2025-12-04 10:02:04 [manheim.gb] INFO: Found listing with ID: 3719784
2025-12-04 10:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273719784%27 HTTP/1.1" 200 None
2025-12-04 10:02:04 [manheim.gb] INFO: Scrape type for 3719784: 1
2025-12-04 10:02:04 [manheim.gb] INFO: Found listing with ID: 3721892
2025-12-04 10:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273721892%27 HTTP/1.1" 200 None
2025-12-04 10:02:04 [manheim.gb] INFO: Scrape type for 3721892: 1
2025-12-04 10:02:04 [manheim.gb] INFO: Found listing with ID: 3732689
2025-12-04 10:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273732689%27 HTTP/1.1" 200 None
2025-12-04 10:02:04 [manheim.gb] INFO: Scrape type for 3732689: 1
2025-12-04 10:02:04 [manheim.gb] INFO: Found listing with ID: 3733108
2025-12-04 10:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273733108%27 HTTP/1.1" 200 None
2025-12-04 10:02:04 [manheim.gb] INFO: Scrape type for 3733108: 1
2025-12-04 10:02:04 [manheim.gb] INFO: Found listing with ID: 3733236
2025-12-04 10:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273733236%27 HTTP/1.1" 200 None
2025-12-04 10:02:04 [manheim.gb] INFO: Scrape type for 3733236: 1
2025-12-04 10:02:04 [manheim.gb] INFO: Found listing with ID: 3736304
2025-12-04 10:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273736304%27 HTTP/1.1" 200 None
2025-12-04 10:02:04 [manheim.gb] INFO: Scrape type for 3736304: 0
2025-12-04 10:02:04 [manheim.gb] INFO: Found listing with ID: 3737427
2025-12-04 10:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273737427%27 HTTP/1.1" 200 None
2025-12-04 10:02:04 [manheim.gb] INFO: Scrape type for 3737427: 1
2025-12-04 10:02:04 [manheim.gb] INFO: Found listing with ID: 3737655
2025-12-04 10:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273737655%27 HTTP/1.1" 200 None
2025-12-04 10:02:04 [manheim.gb] INFO: Scrape type for 3737655: 1
2025-12-04 10:02:04 [manheim.gb] INFO: Found listing with ID: 3737761
2025-12-04 10:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273737761%27 HTTP/1.1" 200 None
2025-12-04 10:02:04 [manheim.gb] INFO: Scrape type for 3737761: 1
2025-12-04 10:02:04 [manheim.gb] INFO: Found listing with ID: 3737827
2025-12-04 10:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273737827%27 HTTP/1.1" 200 None
2025-12-04 10:02:04 [manheim.gb] INFO: Scrape type for 3737827: 1
2025-12-04 10:02:04 [manheim.gb] INFO: Found listing with ID: 3737837
2025-12-04 10:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273737837%27 HTTP/1.1" 200 None
2025-12-04 10:02:04 [manheim.gb] INFO: Scrape type for 3737837: 1
2025-12-04 10:02:04 [manheim.gb] INFO: Found listing with ID: 3737981
2025-12-04 10:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273737981%27 HTTP/1.1" 200 None
2025-12-04 10:02:04 [manheim.gb] INFO: Scrape type for 3737981: 1
2025-12-04 10:02:04 [manheim.gb] INFO: Found listing with ID: 3739898
2025-12-04 10:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273739898%27 HTTP/1.1" 200 None
2025-12-04 10:02:05 [manheim.gb] INFO: Scrape type for 3739898: 1
2025-12-04 10:02:05 [manheim.gb] INFO: Found listing with ID: 3740756
2025-12-04 10:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273740756%27 HTTP/1.1" 200 None
2025-12-04 10:02:05 [manheim.gb] INFO: Scrape type for 3740756: 1
2025-12-04 10:02:05 [manheim.gb] INFO: Found listing with ID: 3748540
2025-12-04 10:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273748540%27 HTTP/1.1" 200 None
2025-12-04 10:02:05 [manheim.gb] INFO: Scrape type for 3748540: 1
2025-12-04 10:02:05 [manheim.gb] INFO: Found listing with ID: 3751763
2025-12-04 10:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273751763%27 HTTP/1.1" 200 None
2025-12-04 10:02:05 [manheim.gb] INFO: Scrape type for 3751763: 1
2025-12-04 10:02:05 [manheim.gb] INFO: Found listing with ID: 3752426
2025-12-04 10:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273752426%27 HTTP/1.1" 200 None
2025-12-04 10:02:05 [manheim.gb] INFO: Scrape type for 3752426: 1
2025-12-04 10:02:05 [manheim.gb] INFO: Found listing with ID: 3752427
2025-12-04 10:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273752427%27 HTTP/1.1" 200 None
2025-12-04 10:02:05 [manheim.gb] INFO: Scrape type for 3752427: 1
2025-12-04 10:02:05 [manheim.gb] INFO: Found listing with ID: 3752430
2025-12-04 10:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273752430%27 HTTP/1.1" 200 None
2025-12-04 10:02:05 [manheim.gb] INFO: Scrape type for 3752430: 1
2025-12-04 10:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/MAZDA/CX5?id=2606673&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232606673&indx=158> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 10:02:05 [manheim.gb] INFO: Found listing with ID: 3753028
2025-12-04 10:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273753028%27 HTTP/1.1" 200 None
2025-12-04 10:02:05 [manheim.gb] INFO: Scrape type for 3753028: 1
2025-12-04 10:02:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 10:02:05 [manheim.gb] INFO: Found listing with ID: 3754025
2025-12-04 10:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273754025%27 HTTP/1.1" 200 None
2025-12-04 10:02:05 [manheim.gb] INFO: Scrape type for 3754025: 1
2025-12-04 10:02:05 [manheim.gb] INFO: Found listing with ID: 3754451
2025-12-04 10:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273754451%27 HTTP/1.1" 200 None
2025-12-04 10:02:05 [manheim.gb] INFO: Scrape type for 3754451: 1
2025-12-04 10:02:05 [manheim.gb] INFO: Found listing with ID: 3758449
2025-12-04 10:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273758449%27 HTTP/1.1" 200 None
2025-12-04 10:02:05 [manheim.gb] INFO: Scrape type for 3758449: 0
2025-12-04 10:02:05 [manheim.gb] INFO: Found listing with ID: 3761623
2025-12-04 10:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273761623%27 HTTP/1.1" 200 None
2025-12-04 10:02:05 [manheim.gb] INFO: Scrape type for 3761623: 1
2025-12-04 10:02:05 [manheim.gb] INFO: Found listing with ID: 3770246
2025-12-04 10:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273770246%27 HTTP/1.1" 200 None
2025-12-04 10:02:05 [manheim.gb] INFO: Scrape type for 3770246: 1
2025-12-04 10:02:05 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field odometer is not nullable
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/manheim.py", line 201, in parse_listings
    scraped_item = self._extract_listing_item(item, expiration_date)
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/manheim.py", line 281, in _extract_listing_item
    item["odometer"] = odometer
    ~~~~^^^^^^^^^^^^
  File "/usr/src/app/crawlers/items.py", line 115, in __setitem__
    raise ValueError(f"Field {key} is not nullable")
ValueError: Field odometer is not nullable
2025-12-04 10:02:06 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field odometer is not nullable
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/manheim.py", line 201, in parse_listings
    scraped_item = self._extract_listing_item(item, expiration_date)
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/manheim.py", line 281, in _extract_listing_item
    item["odometer"] = odometer
    ~~~~^^^^^^^^^^^^
  File "/usr/src/app/crawlers/items.py", line 115, in __setitem__
    raise ValueError(f"Field {key} is not nullable")
ValueError: Field odometer is not nullable
2025-12-04 10:02:06 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field odometer is not nullable
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/manheim.py", line 201, in parse_listings
    scraped_item = self._extract_listing_item(item, expiration_date)
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/manheim.py", line 281, in _extract_listing_item
    item["odometer"] = odometer
    ~~~~^^^^^^^^^^^^
  File "/usr/src/app/crawlers/items.py", line 115, in __setitem__
    raise ValueError(f"Field {key} is not nullable")
ValueError: Field odometer is not nullable
2025-12-04 10:02:06 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field odometer is not nullable
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/manheim.py", line 201, in parse_listings
    scraped_item = self._extract_listing_item(item, expiration_date)
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/manheim.py", line 281, in _extract_listing_item
    item["odometer"] = odometer
    ~~~~^^^^^^^^^^^^
  File "/usr/src/app/crawlers/items.py", line 115, in __setitem__
    raise ValueError(f"Field {key} is not nullable")
ValueError: Field odometer is not nullable
2025-12-04 10:02:06 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field odometer is not nullable
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/manheim.py", line 201, in parse_listings
    scraped_item = self._extract_listing_item(item, expiration_date)
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/manheim.py", line 281, in _extract_listing_item
    item["odometer"] = odometer
    ~~~~^^^^^^^^^^^^
  File "/usr/src/app/crawlers/items.py", line 115, in __setitem__
    raise ValueError(f"Field {key} is not nullable")
ValueError: Field odometer is not nullable
2025-12-04 10:02:06 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field odometer is not nullable
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/manheim.py", line 201, in parse_listings
    scraped_item = self._extract_listing_item(item, expiration_date)
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/manheim.py", line 281, in _extract_listing_item
    item["odometer"] = odometer
    ~~~~^^^^^^^^^^^^
  File "/usr/src/app/crawlers/items.py", line 115, in __setitem__
    raise ValueError(f"Field {key} is not nullable")
ValueError: Field odometer is not nullable
2025-12-04 10:02:06 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field odometer is not nullable
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/manheim.py", line 201, in parse_listings
    scraped_item = self._extract_listing_item(item, expiration_date)
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/manheim.py", line 281, in _extract_listing_item
    item["odometer"] = odometer
    ~~~~^^^^^^^^^^^^
  File "/usr/src/app/crawlers/items.py", line 115, in __setitem__
    raise ValueError(f"Field {key} is not nullable")
ValueError: Field odometer is not nullable
2025-12-04 10:02:06 [scrapy.core.scraper] ERROR: Spider error processing <POST https://www.manheim.co.uk/search/refine> (referer: https://www.manheim.co.uk/search)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 295, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 374, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 355, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 374, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 355, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy_zyte_api/_middlewares.py", line 206, in process_spider_output_async
    async for item_or_request in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/manheim.py", line 201, in parse_listings
    scraped_item = self._extract_listing_item(item, expiration_date)
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/manheim.py", line 281, in _extract_listing_item
    item["odometer"] = odometer
    ~~~~^^^^^^^^^^^^
  File "/usr/src/app/crawlers/items.py", line 115, in __setitem__
    raise ValueError(f"Field {key} is not nullable")
ValueError: Field odometer is not nullable
2025-12-04 10:02:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 591f2d53-8462-59fd-a965-443e232a08fb with identifier: 2606673
2025-12-04 10:02:06 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 591f2d53-8462-59fd-a965-443e232a08fb
2025-12-04 10:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/GOLF?id=3367434&returnUrl=%2Fsearch%3FPage%3D3%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233367434&indx=270> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 10:02:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 10:02:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4852c08-cf28-561f-aac7-d251292092ad with identifier: 3367434
2025-12-04 10:02:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4852c08-cf28-561f-aac7-d251292092ad with scrape type 1
2025-12-04 10:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 18 photos for item f4852c08-cf28-561f-aac7-d251292092ad
2025-12-04 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3367434-4001907-1.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3367434-4001907-1.jpg not downloaded yet
2025-12-04 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3367434-4001907-2.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3367434-4001907-2.jpg not downloaded yet
2025-12-04 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3367434-4001907-3.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3367434-4001907-3.jpg not downloaded yet
2025-12-04 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3367434-4001907-4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3367434-4001907-4.jpg not downloaded yet
2025-12-04 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3367434-4001907-6.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3367434-4001907-6.jpg not downloaded yet
2025-12-04 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3367434-4001907-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3367434-4001907-13.jpg not downloaded yet
2025-12-04 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3367434-4001907-8.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3367434-4001907-8.jpg not downloaded yet
2025-12-04 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3367434-4001907-15.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3367434-4001907-15.jpg not downloaded yet
2025-12-04 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3367434-4001907-16.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3367434-4001907-16.jpg not downloaded yet
2025-12-04 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3367434-4001907-28.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3367434-4001907-28.jpg not downloaded yet
2025-12-04 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3367434-4001907-42.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3367434-4001907-42.jpg not downloaded yet
2025-12-04 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3367434-4001907-43.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3367434-4001907-43.jpg not downloaded yet
2025-12-04 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3367434-4001907-44.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3367434-4001907-44.jpg not downloaded yet
2025-12-04 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3367434-4001907-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3367434-4001907-1000.jpg not downloaded yet
2025-12-04 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3367434-4001907-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3367434-4001907-1001.jpg not downloaded yet
2025-12-04 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3367434-4001907-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3367434-4001907-1002.jpg not downloaded yet
2025-12-04 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3367434-4001907-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3367434-4001907-1003.jpg not downloaded yet
2025-12-04 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3367434-4001907-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3367434-4001907-1004.jpg not downloaded yet
2025-12-04 10:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0002606673-01991003-001.pdf> (referer: None)
2025-12-04 10:02:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce768d0>
2025-12-04 10:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_591f2d53-8462-59fd-a965-443e232a08fb/591f2d53-8462-59fd-a965-443e232a08fb_expert_report_file_60cb399b-b279-435f-9c53-c708cb50c4a1.pdf HTTP/1.1" 201 0
2025-12-04 10:02:21 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 591f2d53-8462-59fd-a965-443e232a08fb
2025-12-04 10:02:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 591f2d53-8462-59fd-a965-443e232a08fb, skipping ID generation
2025-12-04 10:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 591f2d53-8462-59fd-a965-443e232a08fb
2025-12-04 10:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-c66eb974-16b3-4fd7-b2bb-6a54cf828827.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-c66eb974-16b3-4fd7-b2bb-6a54cf828827.jpg not downloaded yet
2025-12-04 10:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F002f07fd-9e73-4e00-b832-1673528a4d8b_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/002f07fd-9e73-4e00-b832-1673528a4d8b_ext_7.jpg not downloaded yet
2025-12-04 10:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-72f616ce-71df-4325-bd2c-ee70985ba07d.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-72f616ce-71df-4325-bd2c-ee70985ba07d.jpg not downloaded yet
2025-12-04 10:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3367434-4001907-1004.jpg> (referer: None)
2025-12-04 10:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-a436c597-756a-4ea1-af9a-aad59a692e0a.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-a436c597-756a-4ea1-af9a-aad59a692e0a.jpg not downloaded yet
2025-12-04 10:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-504a4ec2-6285-4511-901a-44a10da763c1.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-504a4ec2-6285-4511-901a-44a10da763c1.jpg not downloaded yet
2025-12-04 10:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-365ae7ee-76b4-428e-b923-2972a12d6cc0.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-365ae7ee-76b4-428e-b923-2972a12d6cc0.jpg not downloaded yet
2025-12-04 10:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-af5ba8d6-b869-47dd-8a04-4395a99d3b3e.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-af5ba8d6-b869-47dd-8a04-4395a99d3b3e.jpg not downloaded yet
2025-12-04 10:02:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cccdb150>
2025-12-04 10:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4852c08-cf28-561f-aac7-d251292092ad/f4852c08-cf28-561f-aac7-d251292092ad_image_17.jpg HTTP/1.1" 201 0
2025-12-04 10:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3367434-4001907-1004.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3367434-4001907-1004.jpg saved to cache
2025-12-04 10:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item f4852c08-cf28-561f-aac7-d251292092ad
2025-12-04 10:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-3186d138-2acb-442c-b9f0-b2b6a3d8932d.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-3186d138-2acb-442c-b9f0-b2b6a3d8932d.jpg not downloaded yet
2025-12-04 10:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-fdf7af1a-df53-4751-87e2-563938e70f2d.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-fdf7af1a-df53-4751-87e2-563938e70f2d.jpg not downloaded yet
2025-12-04 10:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/002f07fd-9e73-4e00-b832-1673528a4d8b_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002606673-01991003-001.pdf)
2025-12-04 10:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-72528756-f2f7-48a0-bf9a-83b694039cbf.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-72528756-f2f7-48a0-bf9a-83b694039cbf.jpg not downloaded yet
2025-12-04 10:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-c20d1bcd-2eab-48c9-a9ec-a1e8570143ac.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-c20d1bcd-2eab-48c9-a9ec-a1e8570143ac.jpg not downloaded yet
2025-12-04 10:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-70cdf250-cd0f-4680-b5aa-0426870b7c39.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-70cdf250-cd0f-4680-b5aa-0426870b7c39.jpg not downloaded yet
2025-12-04 10:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-da42237d-7899-4c54-92f5-3b6bc6970393.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-da42237d-7899-4c54-92f5-3b6bc6970393.jpg not downloaded yet
2025-12-04 10:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2606673-4007468-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2606673-4007468-13.jpg not downloaded yet
2025-12-04 10:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-888eb2d2-a2a7-4128-a747-47e633a3a0c3.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-888eb2d2-a2a7-4128-a747-47e633a3a0c3.jpg not downloaded yet
2025-12-04 10:02:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc69da50>
2025-12-04 10:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_591f2d53-8462-59fd-a965-443e232a08fb/591f2d53-8462-59fd-a965-443e232a08fb_image_1.jpg HTTP/1.1" 201 0
2025-12-04 10:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F002f07fd-9e73-4e00-b832-1673528a4d8b_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/002f07fd-9e73-4e00-b832-1673528a4d8b_ext_7.jpg saved to cache
2025-12-04 10:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 591f2d53-8462-59fd-a965-443e232a08fb
2025-12-04 10:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-50f8c906-5338-4442-8e33-c183d7d929fe.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-50f8c906-5338-4442-8e33-c183d7d929fe.jpg not downloaded yet
2025-12-04 10:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/Img-fdf7af1a-df53-4751-87e2-563938e70f2d.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002606673-01991003-001.pdf)
2025-12-04 10:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-16f74130-396f-463b-bb4f-8dfbcda0313e.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-16f74130-396f-463b-bb4f-8dfbcda0313e.jpg not downloaded yet
2025-12-04 10:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-e2985488-1bf9-40ee-9c44-5622eaac624e.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-e2985488-1bf9-40ee-9c44-5622eaac624e.jpg not downloaded yet
2025-12-04 10:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-259a7a11-ca0a-47c2-aec8-1e6b91c08805.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-259a7a11-ca0a-47c2-aec8-1e6b91c08805.jpg not downloaded yet
2025-12-04 10:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-386cdcaa-d619-46ec-868a-78a03e00e377.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-386cdcaa-d619-46ec-868a-78a03e00e377.jpg not downloaded yet
2025-12-04 10:02:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6e3e50>
2025-12-04 10:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_591f2d53-8462-59fd-a965-443e232a08fb/591f2d53-8462-59fd-a965-443e232a08fb_image_8.jpg HTTP/1.1" 201 0
2025-12-04 10:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-fdf7af1a-df53-4751-87e2-563938e70f2d.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-fdf7af1a-df53-4751-87e2-563938e70f2d.jpg saved to cache
2025-12-04 10:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 591f2d53-8462-59fd-a965-443e232a08fb
2025-12-04 10:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/Img-50f8c906-5338-4442-8e33-c183d7d929fe.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002606673-01991003-001.pdf)
2025-12-04 10:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/AUDI/A5?id=320240&returnUrl=%2Fsearch%3FPage%3D3%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%23320240&indx=230> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 10:02:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 10:02:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc71b310>
2025-12-04 10:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_591f2d53-8462-59fd-a965-443e232a08fb/591f2d53-8462-59fd-a965-443e232a08fb_image_15.jpg HTTP/1.1" 201 0
2025-12-04 10:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-50f8c906-5338-4442-8e33-c183d7d929fe.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-50f8c906-5338-4442-8e33-c183d7d929fe.jpg saved to cache
2025-12-04 10:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 591f2d53-8462-59fd-a965-443e232a08fb
2025-12-04 10:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/Img-386cdcaa-d619-46ec-868a-78a03e00e377.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002606673-01991003-001.pdf)
2025-12-04 10:02:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a45c47f-ba51-536a-8cb2-0f67e4dbc646 with identifier: 320240
2025-12-04 10:02:23 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 6a45c47f-ba51-536a-8cb2-0f67e4dbc646
2025-12-04 10:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/Img-259a7a11-ca0a-47c2-aec8-1e6b91c08805.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002606673-01991003-001.pdf)
2025-12-04 10:02:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccc49890>
2025-12-04 10:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_591f2d53-8462-59fd-a965-443e232a08fb/591f2d53-8462-59fd-a965-443e232a08fb_image_19.jpg HTTP/1.1" 201 0
2025-12-04 10:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-386cdcaa-d619-46ec-868a-78a03e00e377.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-386cdcaa-d619-46ec-868a-78a03e00e377.jpg saved to cache
2025-12-04 10:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 591f2d53-8462-59fd-a965-443e232a08fb
2025-12-04 10:02:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd22bf90>
2025-12-04 10:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_591f2d53-8462-59fd-a965-443e232a08fb/591f2d53-8462-59fd-a965-443e232a08fb_image_18.jpg HTTP/1.1" 201 0
2025-12-04 10:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-259a7a11-ca0a-47c2-aec8-1e6b91c08805.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-259a7a11-ca0a-47c2-aec8-1e6b91c08805.jpg saved to cache
2025-12-04 10:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 591f2d53-8462-59fd-a965-443e232a08fb
2025-12-04 10:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/Img-e2985488-1bf9-40ee-9c44-5622eaac624e.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002606673-01991003-001.pdf)
2025-12-04 10:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0000320240-01991420-003.pdf> (referer: None)
2025-12-04 10:02:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6b7a90>
2025-12-04 10:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_591f2d53-8462-59fd-a965-443e232a08fb/591f2d53-8462-59fd-a965-443e232a08fb_image_17.jpg HTTP/1.1" 201 0
2025-12-04 10:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-e2985488-1bf9-40ee-9c44-5622eaac624e.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-e2985488-1bf9-40ee-9c44-5622eaac624e.jpg saved to cache
2025-12-04 10:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 591f2d53-8462-59fd-a965-443e232a08fb
2025-12-04 10:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/Img-888eb2d2-a2a7-4128-a747-47e633a3a0c3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002606673-01991003-001.pdf)
2025-12-04 10:02:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cccd0990>
2025-12-04 10:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 10:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_expert_report_file_38caa8d2-afbb-42a1-bee8-04dfdcfa55a9.pdf HTTP/1.1" 201 0
2025-12-04 10:02:25 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 6a45c47f-ba51-536a-8cb2-0f67e4dbc646
2025-12-04 10:02:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6a45c47f-ba51-536a-8cb2-0f67e4dbc646, skipping ID generation
2025-12-04 10:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 6a45c47f-ba51-536a-8cb2-0f67e4dbc646
2025-12-04 10:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcf2cd4e2-893e-4c74-b5a1-90ac42f213eb_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_ext_7.jpg not downloaded yet
2025-12-04 10:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/Img-16f74130-396f-463b-bb4f-8dfbcda0313e.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002606673-01991003-001.pdf)
2025-12-04 10:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcf2cd4e2-893e-4c74-b5a1-90ac42f213eb_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_ext_7.jpg not downloaded yet
2025-12-04 10:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcf2cd4e2-893e-4c74-b5a1-90ac42f213eb_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_ext_6.jpg not downloaded yet
2025-12-04 10:02:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd64f10>
2025-12-04 10:02:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_591f2d53-8462-59fd-a965-443e232a08fb/591f2d53-8462-59fd-a965-443e232a08fb_image_14.jpg HTTP/1.1" 201 0
2025-12-04 10:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-888eb2d2-a2a7-4128-a747-47e633a3a0c3.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-888eb2d2-a2a7-4128-a747-47e633a3a0c3.jpg saved to cache
2025-12-04 10:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 591f2d53-8462-59fd-a965-443e232a08fb
2025-12-04 10:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcf2cd4e2-893e-4c74-b5a1-90ac42f213eb_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_ext_1.jpg not downloaded yet
2025-12-04 10:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=3512008&returnUrl=%2Fsearch%3FPage%3D3%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233512008&indx=292> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 10:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcf2cd4e2-893e-4c74-b5a1-90ac42f213eb_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_5.jpg not downloaded yet
2025-12-04 10:02:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 10:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000320240-01991420-003.pdf)
2025-12-04 10:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2606673-4007468-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002606673-01991003-001.pdf)
2025-12-04 10:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcf2cd4e2-893e-4c74-b5a1-90ac42f213eb_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_4.jpg not downloaded yet
2025-12-04 10:02:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccfc2e10>
2025-12-04 10:02:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_591f2d53-8462-59fd-a965-443e232a08fb/591f2d53-8462-59fd-a965-443e232a08fb_image_16.jpg HTTP/1.1" 201 0
2025-12-04 10:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-16f74130-396f-463b-bb4f-8dfbcda0313e.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-16f74130-396f-463b-bb4f-8dfbcda0313e.jpg saved to cache
2025-12-04 10:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 591f2d53-8462-59fd-a965-443e232a08fb
2025-12-04 10:02:26 [scrapy.extensions.logstats] INFO: Crawled 38 pages (at 35 pages/min), scraped 1 items (at 1 items/min)
2025-12-04 10:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcf2cd4e2-893e-4c74-b5a1-90ac42f213eb_11.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_11.jpg not downloaded yet
2025-12-04 10:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000320240-01991420-003.pdf)
2025-12-04 10:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcf2cd4e2-893e-4c74-b5a1-90ac42f213eb_10.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_10.jpg not downloaded yet
2025-12-04 10:02:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 450fe7de-b611-5eea-a600-69d99fbae57a with identifier: 3512008
2025-12-04 10:02:26 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 450fe7de-b611-5eea-a600-69d99fbae57a
2025-12-04 10:02:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd0e9090>
2025-12-04 10:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_0.jpg HTTP/1.1" 201 0
2025-12-04 10:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcf2cd4e2-893e-4c74-b5a1-90ac42f213eb_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_ext_7.jpg saved to cache
2025-12-04 10:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6a45c47f-ba51-536a-8cb2-0f67e4dbc646
2025-12-04 10:02:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd89b50>
2025-12-04 10:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_591f2d53-8462-59fd-a965-443e232a08fb/591f2d53-8462-59fd-a965-443e232a08fb_image_13.jpg HTTP/1.1" 201 0
2025-12-04 10:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2606673-4007468-13.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2606673-4007468-13.jpg saved to cache
2025-12-04 10:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 591f2d53-8462-59fd-a965-443e232a08fb
2025-12-04 10:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcf2cd4e2-893e-4c74-b5a1-90ac42f213eb_9.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_9.jpg not downloaded yet
2025-12-04 10:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcf2cd4e2-893e-4c74-b5a1-90ac42f213eb_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_ext_2.jpg not downloaded yet
2025-12-04 10:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000320240-01991420-003.pdf)
2025-12-04 10:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000320240-01991420-003.pdf)
2025-12-04 10:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcf2cd4e2-893e-4c74-b5a1-90ac42f213eb_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_ext_5.jpg not downloaded yet
2025-12-04 10:02:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd0ebc50>
2025-12-04 10:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_3.jpg HTTP/1.1" 201 0
2025-12-04 10:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcf2cd4e2-893e-4c74-b5a1-90ac42f213eb_ext_1.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_ext_1.jpg saved to cache
2025-12-04 10:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6a45c47f-ba51-536a-8cb2-0f67e4dbc646
2025-12-04 10:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcf2cd4e2-893e-4c74-b5a1-90ac42f213eb_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_ext_3.jpg not downloaded yet
2025-12-04 10:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000320240-01991420-003.pdf)
2025-12-04 10:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcf2cd4e2-893e-4c74-b5a1-90ac42f213eb_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_ext_4.jpg not downloaded yet
2025-12-04 10:02:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc565a50>
2025-12-04 10:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_5.jpg HTTP/1.1" 201 0
2025-12-04 10:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcf2cd4e2-893e-4c74-b5a1-90ac42f213eb_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_4.jpg saved to cache
2025-12-04 10:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6a45c47f-ba51-536a-8cb2-0f67e4dbc646
2025-12-04 10:02:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd56e10>
2025-12-04 10:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_4.jpg HTTP/1.1" 201 0
2025-12-04 10:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcf2cd4e2-893e-4c74-b5a1-90ac42f213eb_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_5.jpg saved to cache
2025-12-04 10:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6a45c47f-ba51-536a-8cb2-0f67e4dbc646
2025-12-04 10:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-320240-4007446-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-320240-4007446-13.jpg not downloaded yet
2025-12-04 10:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-320240-4007446-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-320240-4007446-1000.jpg not downloaded yet
2025-12-04 10:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000320240-01991420-003.pdf)
2025-12-04 10:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000320240-01991420-003.pdf)
2025-12-04 10:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-320240-4007446-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-320240-4007446-1001.jpg not downloaded yet
2025-12-04 10:02:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6d5fd0>
2025-12-04 10:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 10:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_6.jpg HTTP/1.1" 201 0
2025-12-04 10:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcf2cd4e2-893e-4c74-b5a1-90ac42f213eb_11.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_11.jpg saved to cache
2025-12-04 10:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6a45c47f-ba51-536a-8cb2-0f67e4dbc646
2025-12-04 10:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-320240-4007446-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-320240-4007446-1002.jpg not downloaded yet
2025-12-04 10:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000320240-01991420-003.pdf)
2025-12-04 10:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-320240-4007446-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-320240-4007446-1003.jpg not downloaded yet
2025-12-04 10:02:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccfd3810>
2025-12-04 10:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_8.jpg HTTP/1.1" 201 0
2025-12-04 10:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcf2cd4e2-893e-4c74-b5a1-90ac42f213eb_9.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_9.jpg saved to cache
2025-12-04 10:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6a45c47f-ba51-536a-8cb2-0f67e4dbc646
2025-12-04 10:02:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd0da690>
2025-12-04 10:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 10:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_9.jpg HTTP/1.1" 201 0
2025-12-04 10:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcf2cd4e2-893e-4c74-b5a1-90ac42f213eb_ext_2.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_ext_2.jpg saved to cache
2025-12-04 10:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6a45c47f-ba51-536a-8cb2-0f67e4dbc646
2025-12-04 10:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-320240-4007446-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-320240-4007446-1004.jpg not downloaded yet
2025-12-04 10:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-320240-4007446-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-320240-4007446-1005.jpg not downloaded yet
2025-12-04 10:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/FORD/KUGA?id=3367441&returnUrl=%2Fsearch%3FPage%3D3%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233367441&indx=271> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 10:02:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 10:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-320240-4007446-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000320240-01991420-003.pdf)
2025-12-04 10:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-320240-4007446-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000320240-01991420-003.pdf)
2025-12-04 10:02:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd65650>
2025-12-04 10:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_11.jpg HTTP/1.1" 201 0
2025-12-04 10:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcf2cd4e2-893e-4c74-b5a1-90ac42f213eb_ext_3.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_ext_3.jpg saved to cache
2025-12-04 10:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 6a45c47f-ba51-536a-8cb2-0f67e4dbc646
2025-12-04 10:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-320240-4007446-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000320240-01991420-003.pdf)
2025-12-04 10:02:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ea0b153-3676-5447-9aa2-55baccdf887e with identifier: 3367441
2025-12-04 10:02:29 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 1ea0b153-3676-5447-9aa2-55baccdf887e
2025-12-04 10:02:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccfc3c10>
2025-12-04 10:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_13.jpg HTTP/1.1" 201 0
2025-12-04 10:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-320240-4007446-13.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-320240-4007446-13.jpg saved to cache
2025-12-04 10:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 6a45c47f-ba51-536a-8cb2-0f67e4dbc646
2025-12-04 10:02:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd0e8490>
2025-12-04 10:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_14.jpg HTTP/1.1" 201 0
2025-12-04 10:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-320240-4007446-1000.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-320240-4007446-1000.jpg saved to cache
2025-12-04 10:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 6a45c47f-ba51-536a-8cb2-0f67e4dbc646
2025-12-04 10:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-320240-4007446-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000320240-01991420-003.pdf)
2025-12-04 10:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-320240-4007446-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000320240-01991420-003.pdf)
2025-12-04 10:02:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce6b110>
2025-12-04 10:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_16.jpg HTTP/1.1" 201 0
2025-12-04 10:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-320240-4007446-1002.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-320240-4007446-1002.jpg saved to cache
2025-12-04 10:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 6a45c47f-ba51-536a-8cb2-0f67e4dbc646
2025-12-04 10:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-320240-4007446-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000320240-01991420-003.pdf)
2025-12-04 10:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-320240-4007446-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000320240-01991420-003.pdf)
2025-12-04 10:02:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc54f310>
2025-12-04 10:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_17.jpg HTTP/1.1" 201 0
2025-12-04 10:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-320240-4007446-1003.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-320240-4007446-1003.jpg saved to cache
2025-12-04 10:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 6a45c47f-ba51-536a-8cb2-0f67e4dbc646
2025-12-04 10:02:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd91410>
2025-12-04 10:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_18.jpg HTTP/1.1" 201 0
2025-12-04 10:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-320240-4007446-1004.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-320240-4007446-1004.jpg saved to cache
2025-12-04 10:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 6a45c47f-ba51-536a-8cb2-0f67e4dbc646
2025-12-04 10:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/SUZUKI/SX4?id=3619601&returnUrl=%2Fsearch%3FPage%3D4%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233619601&indx=314> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 10:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000320240-01991420-003.pdf)
2025-12-04 10:02:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 10:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000320240-01991420-003.pdf)
2025-12-04 10:02:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc697090>
2025-12-04 10:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_19.jpg HTTP/1.1" 201 0
2025-12-04 10:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-320240-4007446-1005.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-320240-4007446-1005.jpg saved to cache
2025-12-04 10:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 6a45c47f-ba51-536a-8cb2-0f67e4dbc646
2025-12-04 10:02:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd4afd0>
2025-12-04 10:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_15.jpg HTTP/1.1" 201 0
2025-12-04 10:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-320240-4007446-1001.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-320240-4007446-1001.jpg saved to cache
2025-12-04 10:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 6a45c47f-ba51-536a-8cb2-0f67e4dbc646
2025-12-04 10:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/MG/ZS?id=3622853&returnUrl=%2Fsearch%3FPage%3D4%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233622853&indx=315> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 10:02:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 10:02:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 86dc784c-fdde-5d03-952a-bfd829c570dc with identifier: 3619601
2025-12-04 10:02:31 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 86dc784c-fdde-5d03-952a-bfd829c570dc
2025-12-04 10:02:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd029510>
2025-12-04 10:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_10.jpg HTTP/1.1" 201 0
2025-12-04 10:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcf2cd4e2-893e-4c74-b5a1-90ac42f213eb_ext_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_ext_5.jpg saved to cache
2025-12-04 10:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 6a45c47f-ba51-536a-8cb2-0f67e4dbc646
2025-12-04 10:02:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cccb9390>
2025-12-04 10:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 10:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_12.jpg HTTP/1.1" 201 0
2025-12-04 10:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcf2cd4e2-893e-4c74-b5a1-90ac42f213eb_ext_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_ext_4.jpg saved to cache
2025-12-04 10:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 6a45c47f-ba51-536a-8cb2-0f67e4dbc646
2025-12-04 10:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/SCLASS?id=3616829&returnUrl=%2Fsearch%3FPage%3D4%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233616829&indx=312> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 10:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000320240-01991420-003.pdf)
2025-12-04 10:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000320240-01991420-003.pdf)
2025-12-04 10:02:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 10:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000320240-01991420-003.pdf)
2025-12-04 10:02:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b527688-102b-5f9e-966a-60fdd63cdb49 with identifier: 3622853
2025-12-04 10:02:32 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 6b527688-102b-5f9e-966a-60fdd63cdb49
2025-12-04 10:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003367441-01971190-003.pdf> (referer: None)
2025-12-04 10:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003512008-01990086-001.pdf> (referer: None)
2025-12-04 10:02:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 515a4fc5-e945-522b-ac0a-4ba5a46d480f with identifier: 3616829
2025-12-04 10:02:32 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 515a4fc5-e945-522b-ac0a-4ba5a46d480f
2025-12-04 10:02:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cccff2d0>
2025-12-04 10:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_1.jpg HTTP/1.1" 201 0
2025-12-04 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcf2cd4e2-893e-4c74-b5a1-90ac42f213eb_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_ext_7.jpg saved to cache
2025-12-04 10:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6a45c47f-ba51-536a-8cb2-0f67e4dbc646
2025-12-04 10:02:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccec7b10>
2025-12-04 10:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_7.jpg HTTP/1.1" 201 0
2025-12-04 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcf2cd4e2-893e-4c74-b5a1-90ac42f213eb_10.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_10.jpg saved to cache
2025-12-04 10:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6a45c47f-ba51-536a-8cb2-0f67e4dbc646
2025-12-04 10:02:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd1f6810>
2025-12-04 10:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_2.jpg HTTP/1.1" 201 0
2025-12-04 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcf2cd4e2-893e-4c74-b5a1-90ac42f213eb_ext_6.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_ext_6.jpg saved to cache
2025-12-04 10:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6a45c47f-ba51-536a-8cb2-0f67e4dbc646
2025-12-04 10:02:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6a45c47f-ba51-536a-8cb2-0f67e4dbc646, skipping ID generation
2025-12-04 10:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 6a45c47f-ba51-536a-8cb2-0f67e4dbc646 from tracking dictionaries
2025-12-04 10:02:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6a45c47f-ba51-536a-8cb2-0f67e4dbc646 sending to next pipeline
2025-12-04 10:02:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 6a45c47f-ba51-536a-8cb2-0f67e4dbc646, identifier: 320240
2025-12-04 10:02:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 6a45c47f-ba51-536a-8cb2-0f67e4dbc646 with identifier: 320240
2025-12-04 10:02:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 6a45c47f-ba51-536a-8cb2-0f67e4dbc646 with identifier: 320240
2025-12-04 10:02:34 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 47, 'seller_name': 'swansway garages', 'price_includes_vat': False, 'title': 'audi a5 2.0 tdi 177 se technik 5dr multitronic [5 seat]', 'price': 0, 'currency': 'gbp', 'make': 'audi', 'model': 'a5', 'transmission': 'automatic', 'engine': '2.0l', 'fuel_type': 'diesel', 'odometer': 155020, 'odometer_reading_unit': 'mi', 'registration_date': '2012-11-26', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/audi/a5?id=320240', 'location': 'manchester', 'origin_country_code': 'gb', 'trim': '2.0 tdi 177 se technik 5dr multitronic [5 seat]', 'license_plate': 'kp62ucy', 'year': 2012, 'listing': 'auction', 'c_o_2_emission_value': 127, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0000320240-01991420-003.pdf', 'expiration_date': '2025-12-09t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': '6a45c47f-ba51-536a-8cb2-0f67e4dbc646', 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_expert_report_file_38caa8d2-afbb-42a1-bee8-04dfdcfa55a9.pdf', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_0.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_ext_7.jpg', 'Width': 1499, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 168648}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_1.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_ext_7.jpg', 'Width': 1499, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 168648}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_2.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_ext_6.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 218466}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_3.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_ext_1.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 192792}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_4.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_5.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 180245}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_5.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_4.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 165828}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_6.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_11.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 174733}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_7.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_10.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 167506}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_8.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_9.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 169850}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_9.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_ext_2.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 231542}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_10.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_ext_5.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 186913}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_11.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_ext_3.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 179466}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_12.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_ext_4.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 249131}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_13.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-320240-4007446-13.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 203008}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_14.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-320240-4007446-1000.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 254306}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_15.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-320240-4007446-1001.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 94400}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_16.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-320240-4007446-1002.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 258084}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_17.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-320240-4007446-1003.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 246107}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_18.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-320240-4007446-1004.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 239473}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_19.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-320240-4007446-1005.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 304891}], 'current_year_diff': 13, 'age_in_months': 156, 'make_model': 'audi a5', 'sanitized_make': 'audi', 'odometer_in_km': 249479}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 156,
     'auction_title': '',
     'c_o_2_emission_value': 127,
     'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_expert_report_file_38caa8d2-afbb-42a1-bee8-04dfdcfa55a9.pdf',
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0000320240-01991420-003.pdf',
     'color': 'white',
     'currency': 'gbp',
     'current_year_diff': 13,
     'engine': '2.0l',
     'expiration_date': '2025-12-09t09:00:00z',
     'fuel_type': 'diesel',
     'id': '6a45c47f-ba51-536a-8cb2-0f67e4dbc646',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'kp62ucy',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/audi/a5?id=320240',
     'listing': 'auction',
     'location': 'manchester',
     'make': 'audi',
     'make_model': 'audi a5',
     'model': 'a5',
     'odometer': 155020,
     'odometer_in_km': 249479,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 47,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 168648,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_ext_7.jpg',
                 'Width': 1499},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 168648,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_ext_7.jpg',
                 'Width': 1499},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 218466,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_ext_6.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 192792,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_ext_1.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 180245,
                 'Height': 999,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_5.jpg',
                 'Width': 1500},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 165828,
                 'Height': 999,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_4.jpg',
                 'Width': 1500},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 174733,
                 'Height': 999,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_11.jpg',
                 'Width': 1500},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 167506,
                 'Height': 999,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_10.jpg',
                 'Width': 1500},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 169850,
                 'Height': 999,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_9.jpg',
                 'Width': 1500},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 231542,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_ext_2.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 186913,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_ext_5.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 179466,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_ext_3.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 249131,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_ext_4.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 203008,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-320240-4007446-13.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 254306,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-320240-4007446-1000.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_15.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 94400,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-320240-4007446-1001.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_16.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 258084,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-320240-4007446-1002.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_17.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 246107,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-320240-4007446-1003.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_18.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 239473,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-320240-4007446-1004.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_19.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 304891,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-320240-4007446-1005.jpg',
                 'Width': 1333}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2012-11-26',
     'sanitized_make': 'audi',
     'seller_name': 'swansway garages',
     'title': 'audi a5 2.0 tdi 177 se technik 5dr multitronic [5 seat]',
     'transmission': 'automatic',
     'trim': '2.0 tdi 177 se technik 5dr multitronic [5 seat]',
     'year': 2012}
2025-12-04 10:02:34 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 6a45c47f-ba51-536a-8cb2-0f67e4dbc646 spider: manheim.gb
2025-12-04 10:02:34 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 6a45c47f-ba51-536a-8cb2-0f67e4dbc646 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 47, 'seller_name': 'swansway garages', 'price_includes_vat': False, 'title': 'audi a5 2.0 tdi 177 se technik 5dr multitronic [5 seat]', 'price': 0, 'currency': 'gbp', 'make': 'audi', 'model': 'a5', 'transmission': 'automatic', 'engine': '2.0l', 'fuel_type': 'diesel', 'odometer': 155020, 'odometer_reading_unit': 'mi', 'registration_date': '2012-11-26', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/audi/a5?id=320240', 'location': 'manchester', 'origin_country_code': 'gb', 'trim': '2.0 tdi 177 se technik 5dr multitronic [5 seat]', 'license_plate': 'kp62ucy', 'year': 2012, 'listing': 'auction', 'c_o_2_emission_value': 127, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0000320240-01991420-003.pdf', 'expiration_date': '2025-12-09t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': '6a45c47f-ba51-536a-8cb2-0f67e4dbc646', 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_expert_report_file_38caa8d2-afbb-42a1-bee8-04dfdcfa55a9.pdf', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_0.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_ext_7.jpg', 'Width': 1499, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 168648}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_1.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_ext_7.jpg', 'Width': 1499, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 168648}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_2.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_ext_6.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 218466}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_3.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_ext_1.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 192792}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_4.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_5.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 180245}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_5.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_4.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 165828}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_6.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_11.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 174733}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_7.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_10.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 167506}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_8.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_9.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 169850}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_9.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_ext_2.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 231542}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_10.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_ext_5.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 186913}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_11.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_ext_3.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 179466}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_12.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_ext_4.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 249131}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_13.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-320240-4007446-13.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 203008}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_14.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-320240-4007446-1000.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 254306}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_15.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-320240-4007446-1001.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 94400}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_16.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-320240-4007446-1002.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 258084}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_17.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-320240-4007446-1003.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 246107}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_18.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-320240-4007446-1004.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 239473}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_19.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-320240-4007446-1005.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 304891}], 'current_year_diff': 13, 'age_in_months': 156, 'make_model': 'audi a5', 'sanitized_make': 'audi', 'odometer_in_km': 249479}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 156,
     'auction_title': '',
     'c_o_2_emission_value': 127,
     'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_expert_report_file_38caa8d2-afbb-42a1-bee8-04dfdcfa55a9.pdf',
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0000320240-01991420-003.pdf',
     'color': 'white',
     'currency': 'gbp',
     'current_year_diff': 13,
     'engine': '2.0l',
     'expiration_date': '2025-12-09t09:00:00z',
     'fuel_type': 'diesel',
     'id': '6a45c47f-ba51-536a-8cb2-0f67e4dbc646',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'kp62ucy',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/audi/a5?id=320240',
     'listing': 'auction',
     'location': 'manchester',
     'make': 'audi',
     'make_model': 'audi a5',
     'model': 'a5',
     'odometer': 155020,
     'odometer_in_km': 249479,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 47,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 168648,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_ext_7.jpg',
                 'Width': 1499},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 168648,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_ext_7.jpg',
                 'Width': 1499},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 218466,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_ext_6.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 192792,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_ext_1.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 180245,
                 'Height': 999,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_5.jpg',
                 'Width': 1500},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 165828,
                 'Height': 999,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_4.jpg',
                 'Width': 1500},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 174733,
                 'Height': 999,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_11.jpg',
                 'Width': 1500},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 167506,
                 'Height': 999,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_10.jpg',
                 'Width': 1500},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 169850,
                 'Height': 999,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_9.jpg',
                 'Width': 1500},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 231542,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_ext_2.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 186913,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_ext_5.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 179466,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_ext_3.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 249131,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_ext_4.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 203008,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-320240-4007446-13.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 254306,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-320240-4007446-1000.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_15.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 94400,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-320240-4007446-1001.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_16.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 258084,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-320240-4007446-1002.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_17.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 246107,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-320240-4007446-1003.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_18.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 239473,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-320240-4007446-1004.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_19.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 304891,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-320240-4007446-1005.jpg',
                 'Width': 1333}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2012-11-26',
     'sanitized_make': 'audi',
     'seller_name': 'swansway garages',
     'title': 'audi a5 2.0 tdi 177 se technik 5dr multitronic [5 seat]',
     'transmission': 'automatic',
     'trim': '2.0 tdi 177 se technik 5dr multitronic [5 seat]',
     'year': 2012}
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_expert_report_file_38caa8d2-afbb-42a1-bee8-04dfdcfa55a9.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0000320240-01991420-003.pdf',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '6a45c47f-ba51-536a-8cb2-0f67e4dbc646',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'KP62UCY',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/AUDI/A5?id=320240',
 'listing': 'auction',
 'location': 'Manchester',
 'make': 'AUDI',
 'model': 'A5',
 'odometer': 155020,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 47,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 168648,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 168648,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 218466,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 192792,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 180245,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_5.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 165828,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_4.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 174733,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_11.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 167506,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_10.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 169850,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_9.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 231542,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 186913,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 179466,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 249131,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cf2cd4e2-893e-4c74-b5a1-90ac42f213eb_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 203008,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-320240-4007446-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 254306,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-320240-4007446-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94400,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-320240-4007446-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 258084,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-320240-4007446-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 246107,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-320240-4007446-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 239473,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-320240-4007446-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a45c47f-ba51-536a-8cb2-0f67e4dbc646/6a45c47f-ba51-536a-8cb2-0f67e4dbc646_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 304891,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-320240-4007446-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-26',
 'seller_name': 'Swansway Garages',
 'title': 'AUDI A5 2.0 TDI 177 SE Technik 5dr Multitronic [5 Seat]',
 'transmission': 'automatic',
 'trim': '2.0 TDI 177 SE Technik 5dr Multitronic [5 Seat]',
 'year': 2012}
2025-12-04 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27320240%27 HTTP/1.1" 200 None
2025-12-04 10:02:34 [manheim.gb] INFO: Saving data for 320240: {'created_time': 1764842554.439664, 'last_price_update_time': 1764842554.439679, 'auction_closing_time': 1765270800.0}
2025-12-04 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='320240') HTTP/1.1" 204 0
2025-12-04 10:02:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce900d0>
2025-12-04 10:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 10:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ea0b153-3676-5447-9aa2-55baccdf887e/1ea0b153-3676-5447-9aa2-55baccdf887e_expert_report_file_44722bf9-70e9-49fb-a2ff-a495c7605729.pdf HTTP/1.1" 201 0
2025-12-04 10:02:35 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 1ea0b153-3676-5447-9aa2-55baccdf887e
2025-12-04 10:02:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1ea0b153-3676-5447-9aa2-55baccdf887e, skipping ID generation
2025-12-04 10:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 1ea0b153-3676-5447-9aa2-55baccdf887e
2025-12-04 10:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F79405aed-99b3-44dc-adee-43fe1c1cd635_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/79405aed-99b3-44dc-adee-43fe1c1cd635_ext_7.jpg not downloaded yet
2025-12-04 10:02:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccdb5dd0>
2025-12-04 10:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_450fe7de-b611-5eea-a600-69d99fbae57a/450fe7de-b611-5eea-a600-69d99fbae57a_expert_report_file_ea7927dd-788e-4307-a851-d5d4182e3e0e.pdf HTTP/1.1" 201 0
2025-12-04 10:02:35 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 450fe7de-b611-5eea-a600-69d99fbae57a
2025-12-04 10:02:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 450fe7de-b611-5eea-a600-69d99fbae57a, skipping ID generation
2025-12-04 10:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 450fe7de-b611-5eea-a600-69d99fbae57a
2025-12-04 10:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F694f1162-fd52-4da5-a1c2-1fc6a414cdba_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/694f1162-fd52-4da5-a1c2-1fc6a414cdba_ext_7.jpg not downloaded yet
2025-12-04 10:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/Img-70cdf250-cd0f-4680-b5aa-0426870b7c39.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002606673-01991003-001.pdf)
2025-12-04 10:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/Img-72528756-f2f7-48a0-bf9a-83b694039cbf.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002606673-01991003-001.pdf)
2025-12-04 10:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/Img-c20d1bcd-2eab-48c9-a9ec-a1e8570143ac.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002606673-01991003-001.pdf)
2025-12-04 10:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/Img-da42237d-7899-4c54-92f5-3b6bc6970393.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002606673-01991003-001.pdf)
2025-12-04 10:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F79405aed-99b3-44dc-adee-43fe1c1cd635_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/79405aed-99b3-44dc-adee-43fe1c1cd635_ext_7.jpg not downloaded yet
2025-12-04 10:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F694f1162-fd52-4da5-a1c2-1fc6a414cdba_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/694f1162-fd52-4da5-a1c2-1fc6a414cdba_ext_7.jpg not downloaded yet
2025-12-04 10:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F79405aed-99b3-44dc-adee-43fe1c1cd635_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/79405aed-99b3-44dc-adee-43fe1c1cd635_ext_6.jpg not downloaded yet
2025-12-04 10:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F694f1162-fd52-4da5-a1c2-1fc6a414cdba_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/694f1162-fd52-4da5-a1c2-1fc6a414cdba_ext_6.jpg not downloaded yet
2025-12-04 10:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F79405aed-99b3-44dc-adee-43fe1c1cd635_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/79405aed-99b3-44dc-adee-43fe1c1cd635_ext_1.jpg not downloaded yet
2025-12-04 10:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F694f1162-fd52-4da5-a1c2-1fc6a414cdba_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/694f1162-fd52-4da5-a1c2-1fc6a414cdba_ext_1.jpg not downloaded yet
2025-12-04 10:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F79405aed-99b3-44dc-adee-43fe1c1cd635_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/79405aed-99b3-44dc-adee-43fe1c1cd635_5.jpg not downloaded yet
2025-12-04 10:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F694f1162-fd52-4da5-a1c2-1fc6a414cdba_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/694f1162-fd52-4da5-a1c2-1fc6a414cdba_5.jpg not downloaded yet
2025-12-04 10:02:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf9d610>
2025-12-04 10:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_591f2d53-8462-59fd-a965-443e232a08fb/591f2d53-8462-59fd-a965-443e232a08fb_image_11.jpg HTTP/1.1" 201 0
2025-12-04 10:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-70cdf250-cd0f-4680-b5aa-0426870b7c39.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-70cdf250-cd0f-4680-b5aa-0426870b7c39.jpg saved to cache
2025-12-04 10:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 591f2d53-8462-59fd-a965-443e232a08fb
2025-12-04 10:02:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc56ee90>
2025-12-04 10:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_591f2d53-8462-59fd-a965-443e232a08fb/591f2d53-8462-59fd-a965-443e232a08fb_image_9.jpg HTTP/1.1" 201 0
2025-12-04 10:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-72528756-f2f7-48a0-bf9a-83b694039cbf.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-72528756-f2f7-48a0-bf9a-83b694039cbf.jpg saved to cache
2025-12-04 10:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 591f2d53-8462-59fd-a965-443e232a08fb
2025-12-04 10:02:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd0c0a50>
2025-12-04 10:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_591f2d53-8462-59fd-a965-443e232a08fb/591f2d53-8462-59fd-a965-443e232a08fb_image_10.jpg HTTP/1.1" 201 0
2025-12-04 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-c20d1bcd-2eab-48c9-a9ec-a1e8570143ac.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-c20d1bcd-2eab-48c9-a9ec-a1e8570143ac.jpg saved to cache
2025-12-04 10:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 591f2d53-8462-59fd-a965-443e232a08fb
2025-12-04 10:02:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc653310>
2025-12-04 10:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_591f2d53-8462-59fd-a965-443e232a08fb/591f2d53-8462-59fd-a965-443e232a08fb_image_12.jpg HTTP/1.1" 201 0
2025-12-04 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-da42237d-7899-4c54-92f5-3b6bc6970393.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-da42237d-7899-4c54-92f5-3b6bc6970393.jpg saved to cache
2025-12-04 10:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 591f2d53-8462-59fd-a965-443e232a08fb
2025-12-04 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F79405aed-99b3-44dc-adee-43fe1c1cd635_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/79405aed-99b3-44dc-adee-43fe1c1cd635_4.jpg not downloaded yet
2025-12-04 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F694f1162-fd52-4da5-a1c2-1fc6a414cdba_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/694f1162-fd52-4da5-a1c2-1fc6a414cdba_4.jpg not downloaded yet
2025-12-04 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F79405aed-99b3-44dc-adee-43fe1c1cd635_11.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/79405aed-99b3-44dc-adee-43fe1c1cd635_11.jpg not downloaded yet
2025-12-04 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F694f1162-fd52-4da5-a1c2-1fc6a414cdba_11.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/694f1162-fd52-4da5-a1c2-1fc6a414cdba_11.jpg not downloaded yet
2025-12-04 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F79405aed-99b3-44dc-adee-43fe1c1cd635_10.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/79405aed-99b3-44dc-adee-43fe1c1cd635_10.jpg not downloaded yet
2025-12-04 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F694f1162-fd52-4da5-a1c2-1fc6a414cdba_10.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/694f1162-fd52-4da5-a1c2-1fc6a414cdba_10.jpg not downloaded yet
2025-12-04 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F79405aed-99b3-44dc-adee-43fe1c1cd635_9.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/79405aed-99b3-44dc-adee-43fe1c1cd635_9.jpg not downloaded yet
2025-12-04 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F694f1162-fd52-4da5-a1c2-1fc6a414cdba_9.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/694f1162-fd52-4da5-a1c2-1fc6a414cdba_9.jpg not downloaded yet
2025-12-04 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F79405aed-99b3-44dc-adee-43fe1c1cd635_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/79405aed-99b3-44dc-adee-43fe1c1cd635_ext_2.jpg not downloaded yet
2025-12-04 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F694f1162-fd52-4da5-a1c2-1fc6a414cdba_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/694f1162-fd52-4da5-a1c2-1fc6a414cdba_ext_2.jpg not downloaded yet
2025-12-04 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F79405aed-99b3-44dc-adee-43fe1c1cd635_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/79405aed-99b3-44dc-adee-43fe1c1cd635_ext_5.jpg not downloaded yet
2025-12-04 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F694f1162-fd52-4da5-a1c2-1fc6a414cdba_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/694f1162-fd52-4da5-a1c2-1fc6a414cdba_ext_5.jpg not downloaded yet
2025-12-04 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F79405aed-99b3-44dc-adee-43fe1c1cd635_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/79405aed-99b3-44dc-adee-43fe1c1cd635_ext_3.jpg not downloaded yet
2025-12-04 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F694f1162-fd52-4da5-a1c2-1fc6a414cdba_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/694f1162-fd52-4da5-a1c2-1fc6a414cdba_ext_3.jpg not downloaded yet
2025-12-04 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F79405aed-99b3-44dc-adee-43fe1c1cd635_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/79405aed-99b3-44dc-adee-43fe1c1cd635_ext_4.jpg not downloaded yet
2025-12-04 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F694f1162-fd52-4da5-a1c2-1fc6a414cdba_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/694f1162-fd52-4da5-a1c2-1fc6a414cdba_ext_4.jpg not downloaded yet
2025-12-04 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3367441-3989148-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3367441-3989148-13.jpg not downloaded yet
2025-12-04 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3512008-4007566-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3512008-4007566-13.jpg not downloaded yet
2025-12-04 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3367441-3989148-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3367441-3989148-1000.jpg not downloaded yet
2025-12-04 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3512008-4007566-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3512008-4007566-1000.jpg not downloaded yet
2025-12-04 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3367441-3989148-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3367441-3989148-1001.jpg not downloaded yet
2025-12-04 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3512008-4007566-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3512008-4007566-1001.jpg not downloaded yet
2025-12-04 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3367441-3989148-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3367441-3989148-1002.jpg not downloaded yet
2025-12-04 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3512008-4007566-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3512008-4007566-1002.jpg not downloaded yet
2025-12-04 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3367441-3989148-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3367441-3989148-1003.jpg not downloaded yet
2025-12-04 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3512008-4007566-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3512008-4007566-1003.jpg not downloaded yet
2025-12-04 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3367441-3989148-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3367441-3989148-1004.jpg not downloaded yet
2025-12-04 10:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3512008-4007566-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3512008-4007566-1004.jpg not downloaded yet
2025-12-04 10:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3367441-3989148-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3367441-3989148-1005.jpg not downloaded yet
2025-12-04 10:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3512008-4007566-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3512008-4007566-1005.jpg not downloaded yet
2025-12-04 10:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003619601-01984218-001.pdf> (referer: None)
2025-12-04 10:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003622853-01940366-004.pdf> (referer: None)
2025-12-04 10:02:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce85d50>
2025-12-04 10:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_expert_report_file_d67b7120-0f4b-4227-9848-01a93ae7fb82.pdf HTTP/1.1" 201 0
2025-12-04 10:02:38 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 86dc784c-fdde-5d03-952a-bfd829c570dc
2025-12-04 10:02:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 86dc784c-fdde-5d03-952a-bfd829c570dc, skipping ID generation
2025-12-04 10:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 86dc784c-fdde-5d03-952a-bfd829c570dc
2025-12-04 10:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff0089895-11d9-4c88-a334-4c3a61bc1e9d_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_ext_7.jpg not downloaded yet
2025-12-04 10:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff0089895-11d9-4c88-a334-4c3a61bc1e9d_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_ext_7.jpg not downloaded yet
2025-12-04 10:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff0089895-11d9-4c88-a334-4c3a61bc1e9d_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_ext_6.jpg not downloaded yet
2025-12-04 10:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3512008-4007566-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003512008-01990086-001.pdf)
2025-12-04 10:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3512008-4007566-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003512008-01990086-001.pdf)
2025-12-04 10:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3367441-3989148-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003367441-01971190-003.pdf)
2025-12-04 10:02:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccfd2890>
2025-12-04 10:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_expert_report_file_0fe5f528-64c3-4f71-b532-593f0c9500cb.pdf HTTP/1.1" 201 0
2025-12-04 10:02:38 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 6b527688-102b-5f9e-966a-60fdd63cdb49
2025-12-04 10:02:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6b527688-102b-5f9e-966a-60fdd63cdb49, skipping ID generation
2025-12-04 10:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 6b527688-102b-5f9e-966a-60fdd63cdb49
2025-12-04 10:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Faf1c10e6-155f-4738-ba3d-3ab786304a3c_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_7.jpg already downloaded
2025-12-04 10:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Faf1c10e6-155f-4738-ba3d-3ab786304a3c_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_7.jpg already downloaded
2025-12-04 10:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Faf1c10e6-155f-4738-ba3d-3ab786304a3c_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_6.jpg already downloaded
2025-12-04 10:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Faf1c10e6-155f-4738-ba3d-3ab786304a3c_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_1.jpg already downloaded
2025-12-04 10:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Faf1c10e6-155f-4738-ba3d-3ab786304a3c_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_5.jpg already downloaded
2025-12-04 10:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Faf1c10e6-155f-4738-ba3d-3ab786304a3c_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_4.jpg already downloaded
2025-12-04 10:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Faf1c10e6-155f-4738-ba3d-3ab786304a3c_11.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_11.jpg already downloaded
2025-12-04 10:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Faf1c10e6-155f-4738-ba3d-3ab786304a3c_10.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_10.jpg already downloaded
2025-12-04 10:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Faf1c10e6-155f-4738-ba3d-3ab786304a3c_9.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_9.jpg already downloaded
2025-12-04 10:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Faf1c10e6-155f-4738-ba3d-3ab786304a3c_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_2.jpg already downloaded
2025-12-04 10:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Faf1c10e6-155f-4738-ba3d-3ab786304a3c_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_5.jpg already downloaded
2025-12-04 10:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Faf1c10e6-155f-4738-ba3d-3ab786304a3c_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_3.jpg already downloaded
2025-12-04 10:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Faf1c10e6-155f-4738-ba3d-3ab786304a3c_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_4.jpg already downloaded
2025-12-04 10:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3622853-3976657-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3622853-3976657-13.jpg already downloaded
2025-12-04 10:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3622853-3976657-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3622853-3976657-1000.jpg already downloaded
2025-12-04 10:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3622853-3976657-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3622853-3976657-1001.jpg already downloaded
2025-12-04 10:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3622853-3976657-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3622853-3976657-1002.jpg already downloaded
2025-12-04 10:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3622853-3976657-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3622853-3976657-1003.jpg already downloaded
2025-12-04 10:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3622853-3976657-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3622853-3976657-1004.jpg already downloaded
2025-12-04 10:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3622853-3976657-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3622853-3976657-1005.jpg already downloaded
2025-12-04 10:02:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 6b527688-102b-5f9e-966a-60fdd63cdb49, identifier: 3622853
2025-12-04 10:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3367441-3989148-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003367441-01971190-003.pdf)
2025-12-04 10:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff0089895-11d9-4c88-a334-4c3a61bc1e9d_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_ext_1.jpg not downloaded yet
2025-12-04 10:02:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 6b527688-102b-5f9e-966a-60fdd63cdb49 with identifier: 3622853
2025-12-04 10:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-04 10:02:39 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Electric HTTP/1.1" 200 None
2025-12-04 10:02:39 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-04 10:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-04 10:02:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 6b527688-102b-5f9e-966a-60fdd63cdb49 with identifier: 3622853
2025-12-04 10:02:40 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 61, 'seller_name': 'santander consumer', 'price_includes_vat': False, 'title': 'mg zs 105kw exclusive ev 45kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'mg', 'model': 'zs', 'transmission': 'automatic', 'engine': '0.0l', 'fuel_type': 'electric', 'odometer': 35662, 'odometer_reading_unit': 'mi', 'registration_date': '2020-10-23', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/mg/zs?id=3622853', 'location': 'bristol', 'origin_country_code': 'gb', 'trim': '105kw exclusive ev 45kwh 5dr auto', 'license_plate': 'cn70xuy', 'year': 2020, 'listing': 'auction', 'c_o_2_emission_value': 0, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0003622853-01940366-004.pdf', 'expiration_date': '2025-12-16t09:00:00z', 'is_vat_deductible': True, 'is_vat_included': False, 'photo_urls': ['http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_7.jpg', 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_7.jpg', 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_6.jpg', 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_1.jpg', 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_5.jpg', 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_4.jpg', 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_11.jpg', 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_10.jpg', 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_9.jpg', 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_2.jpg', 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_5.jpg', 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_3.jpg', 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_4.jpg', 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3622853-3976657-13.jpg', 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3622853-3976657-1000.jpg', 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3622853-3976657-1001.jpg', 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3622853-3976657-1002.jpg', 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3622853-3976657-1003.jpg', 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3622853-3976657-1004.jpg', 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3622853-3976657-1005.jpg'], 'id': '6b527688-102b-5f9e-966a-60fdd63cdb49', 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_expert_report_file_0fe5f528-64c3-4f71-b532-593f0c9500cb.pdf', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_0.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_7.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 262423}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_0.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_7.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 262423}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_2.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_6.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 273978}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_3.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_1.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 235464}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_4.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_5.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 233104}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_5.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_4.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 244144}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_6.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_11.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 202536}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_7.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_10.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 243280}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_8.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_9.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 232721}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_9.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_2.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 275806}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_10.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_5.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 225025}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_11.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_3.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 213047}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_12.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_4.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 358710}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_13.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3622853-3976657-13.jpg', 'Width': 1500, 'Height': 937, 'Extension': 'jpg', 'FileSizeInBytes': 573971}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_14.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3622853-3976657-1000.jpg', 'Width': 1500, 'Height': 937, 'Extension': 'jpg', 'FileSizeInBytes': 335474}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_15.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3622853-3976657-1001.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 284395}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_16.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3622853-3976657-1002.jpg', 'Width': 1500, 'Height': 937, 'Extension': 'jpg', 'FileSizeInBytes': 420697}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_17.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3622853-3976657-1003.jpg', 'Width': 1500, 'Height': 937, 'Extension': 'jpg', 'FileSizeInBytes': 501881}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_18.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3622853-3976657-1004.jpg', 'Width': 1500, 'Height': 937, 'Extension': 'jpg', 'FileSizeInBytes': 279784}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_19.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3622853-3976657-1005.jpg', 'Width': 1500, 'Height': 937, 'Extension': 'jpg', 'FileSizeInBytes': 476864}], 'current_year_diff': 5, 'age_in_months': 61, 'make_model': 'mg zs', 'sanitized_make': 'mg', 'odometer_in_km': 57392} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 61,
     'auction_title': '',
     'c_o_2_emission_value': 0,
     'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_expert_report_file_0fe5f528-64c3-4f71-b532-593f0c9500cb.pdf',
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0003622853-01940366-004.pdf',
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 5,
     'engine': '0.0l',
     'expiration_date': '2025-12-16t09:00:00z',
     'fuel_type': 'electric',
     'id': '6b527688-102b-5f9e-966a-60fdd63cdb49',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'cn70xuy',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/mg/zs?id=3622853',
     'listing': 'auction',
     'location': 'bristol',
     'make': 'mg',
     'make_model': 'mg zs',
     'model': 'zs',
     'odometer': 35662,
     'odometer_in_km': 57392,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 61,
     'photo_urls': ['http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_7.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_7.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_6.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_1.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_5.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_4.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_11.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_10.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_9.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_2.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_5.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_3.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_4.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/insp-0001-3622853-3976657-13.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/insp-0001-3622853-3976657-1000.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/insp-0001-3622853-3976657-1001.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/insp-0001-3622853-3976657-1002.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/insp-0001-3622853-3976657-1003.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/insp-0001-3622853-3976657-1004.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/insp-0001-3622853-3976657-1005.jpg'],
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 262423,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_7.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 262423,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_7.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 273978,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_6.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 235464,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_1.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 233104,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_5.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 244144,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_4.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 202536,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_11.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 243280,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_10.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 232721,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_9.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 275806,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_2.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 225025,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_5.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 213047,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_3.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 358710,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_4.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 573971,
                 'Height': 937,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3622853-3976657-13.jpg',
                 'Width': 1500},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 335474,
                 'Height': 937,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3622853-3976657-1000.jpg',
                 'Width': 1500},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_15.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 284395,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3622853-3976657-1001.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_16.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 420697,
                 'Height': 937,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3622853-3976657-1002.jpg',
                 'Width': 1500},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_17.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 501881,
                 'Height': 937,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3622853-3976657-1003.jpg',
                 'Width': 1500},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_18.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 279784,
                 'Height': 937,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3622853-3976657-1004.jpg',
                 'Width': 1500},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_19.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 476864,
                 'Height': 937,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3622853-3976657-1005.jpg',
                 'Width': 1500}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2020-10-23',
     'sanitized_make': 'mg',
     'seller_name': 'santander consumer',
     'title': 'mg zs 105kw exclusive ev 45kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '105kw exclusive ev 45kwh 5dr auto',
     'year': 2020}
2025-12-04 10:02:40 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 6b527688-102b-5f9e-966a-60fdd63cdb49 spider: manheim.gb
2025-12-04 10:02:40 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 6b527688-102b-5f9e-966a-60fdd63cdb49 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 61, 'seller_name': 'santander consumer', 'price_includes_vat': False, 'title': 'mg zs 105kw exclusive ev 45kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'mg', 'model': 'zs', 'transmission': 'automatic', 'engine': '0.0l', 'fuel_type': 'electric', 'odometer': 35662, 'odometer_reading_unit': 'mi', 'registration_date': '2020-10-23', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/mg/zs?id=3622853', 'location': 'bristol', 'origin_country_code': 'gb', 'trim': '105kw exclusive ev 45kwh 5dr auto', 'license_plate': 'cn70xuy', 'year': 2020, 'listing': 'auction', 'c_o_2_emission_value': 0, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0003622853-01940366-004.pdf', 'expiration_date': '2025-12-16t09:00:00z', 'is_vat_deductible': True, 'is_vat_included': False, 'photo_urls': ['http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_7.jpg', 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_7.jpg', 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_6.jpg', 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_1.jpg', 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_5.jpg', 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_4.jpg', 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_11.jpg', 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_10.jpg', 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_9.jpg', 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_2.jpg', 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_5.jpg', 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_3.jpg', 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_4.jpg', 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3622853-3976657-13.jpg', 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3622853-3976657-1000.jpg', 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3622853-3976657-1001.jpg', 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3622853-3976657-1002.jpg', 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3622853-3976657-1003.jpg', 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3622853-3976657-1004.jpg', 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3622853-3976657-1005.jpg'], 'id': '6b527688-102b-5f9e-966a-60fdd63cdb49', 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_expert_report_file_0fe5f528-64c3-4f71-b532-593f0c9500cb.pdf', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_0.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_7.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 262423}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_0.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_7.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 262423}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_2.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_6.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 273978}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_3.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_1.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 235464}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_4.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_5.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 233104}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_5.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_4.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 244144}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_6.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_11.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 202536}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_7.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_10.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 243280}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_8.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_9.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 232721}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_9.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_2.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 275806}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_10.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_5.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 225025}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_11.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_3.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 213047}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_12.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_4.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 358710}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_13.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3622853-3976657-13.jpg', 'Width': 1500, 'Height': 937, 'Extension': 'jpg', 'FileSizeInBytes': 573971}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_14.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3622853-3976657-1000.jpg', 'Width': 1500, 'Height': 937, 'Extension': 'jpg', 'FileSizeInBytes': 335474}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_15.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3622853-3976657-1001.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 284395}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_16.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3622853-3976657-1002.jpg', 'Width': 1500, 'Height': 937, 'Extension': 'jpg', 'FileSizeInBytes': 420697}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_17.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3622853-3976657-1003.jpg', 'Width': 1500, 'Height': 937, 'Extension': 'jpg', 'FileSizeInBytes': 501881}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_18.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3622853-3976657-1004.jpg', 'Width': 1500, 'Height': 937, 'Extension': 'jpg', 'FileSizeInBytes': 279784}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_19.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3622853-3976657-1005.jpg', 'Width': 1500, 'Height': 937, 'Extension': 'jpg', 'FileSizeInBytes': 476864}], 'current_year_diff': 5, 'age_in_months': 61, 'make_model': 'mg zs', 'sanitized_make': 'mg', 'odometer_in_km': 57392} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 61,
     'auction_title': '',
     'c_o_2_emission_value': 0,
     'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_expert_report_file_0fe5f528-64c3-4f71-b532-593f0c9500cb.pdf',
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0003622853-01940366-004.pdf',
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 5,
     'engine': '0.0l',
     'expiration_date': '2025-12-16t09:00:00z',
     'fuel_type': 'electric',
     'id': '6b527688-102b-5f9e-966a-60fdd63cdb49',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'cn70xuy',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/mg/zs?id=3622853',
     'listing': 'auction',
     'location': 'bristol',
     'make': 'mg',
     'make_model': 'mg zs',
     'model': 'zs',
     'odometer': 35662,
     'odometer_in_km': 57392,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 61,
     'photo_urls': ['http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_7.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_7.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_6.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_1.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_5.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_4.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_11.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_10.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_9.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_2.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_5.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_3.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_4.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/insp-0001-3622853-3976657-13.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/insp-0001-3622853-3976657-1000.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/insp-0001-3622853-3976657-1001.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/insp-0001-3622853-3976657-1002.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/insp-0001-3622853-3976657-1003.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/insp-0001-3622853-3976657-1004.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/insp-0001-3622853-3976657-1005.jpg'],
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 262423,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_7.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 262423,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_7.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 273978,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_6.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 235464,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_1.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 233104,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_5.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 244144,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_4.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 202536,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_11.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 243280,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_10.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 232721,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_9.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 275806,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_2.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 225025,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_5.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 213047,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_3.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 358710,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_4.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 573971,
                 'Height': 937,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3622853-3976657-13.jpg',
                 'Width': 1500},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 335474,
                 'Height': 937,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3622853-3976657-1000.jpg',
                 'Width': 1500},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_15.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 284395,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3622853-3976657-1001.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_16.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 420697,
                 'Height': 937,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3622853-3976657-1002.jpg',
                 'Width': 1500},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_17.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 501881,
                 'Height': 937,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3622853-3976657-1003.jpg',
                 'Width': 1500},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_18.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 279784,
                 'Height': 937,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3622853-3976657-1004.jpg',
                 'Width': 1500},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_19.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 476864,
                 'Height': 937,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3622853-3976657-1005.jpg',
                 'Width': 1500}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2020-10-23',
     'sanitized_make': 'mg',
     'seller_name': 'santander consumer',
     'title': 'mg zs 105kw exclusive ev 45kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '105kw exclusive ev 45kwh 5dr auto',
     'year': 2020}
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_expert_report_file_0fe5f528-64c3-4f71-b532-593f0c9500cb.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003622853-01940366-004.pdf',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '0.0L',
 'expiration_date': '2025-12-16T09:00:00Z',
 'fuel_type': 'Electric',
 'id': '6b527688-102b-5f9e-966a-60fdd63cdb49',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'CN70XUY',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MG/ZS?id=3622853',
 'listing': 'auction',
 'location': 'Bristol',
 'make': 'MG',
 'model': 'ZS',
 'odometer': 35662,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 61,
 'photo_urls': ['http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_7.jpg',
                'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_7.jpg',
                'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_6.jpg',
                'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_1.jpg',
                'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_5.jpg',
                'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_4.jpg',
                'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_11.jpg',
                'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_10.jpg',
                'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_9.jpg',
                'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_2.jpg',
                'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_5.jpg',
                'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_3.jpg',
                'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_4.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3622853-3976657-13.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3622853-3976657-1000.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3622853-3976657-1001.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3622853-3976657-1002.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3622853-3976657-1003.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3622853-3976657-1004.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3622853-3976657-1005.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 262423,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 262423,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 273978,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 235464,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 233104,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 244144,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 202536,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 243280,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 232721,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 275806,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 225025,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 213047,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 358710,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/af1c10e6-155f-4738-ba3d-3ab786304a3c_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 573971,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3622853-3976657-13.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 335474,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3622853-3976657-1000.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 284395,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3622853-3976657-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 420697,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3622853-3976657-1002.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 501881,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3622853-3976657-1003.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 279784,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3622853-3976657-1004.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b527688-102b-5f9e-966a-60fdd63cdb49/6b527688-102b-5f9e-966a-60fdd63cdb49_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 476864,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3622853-3976657-1005.jpg',
             'Width': 1500}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-23',
 'seller_name': 'Santander Consumer',
 'title': 'MG ZS 105kW Exclusive EV 45kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '105kW Exclusive EV 45kWh 5dr Auto',
 'year': 2020}
2025-12-04 10:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273622853%27 HTTP/1.1" 200 None
2025-12-04 10:02:40 [manheim.gb] INFO: Saving data for 3622853: {'created_time': 1764842560.234869, 'last_price_update_time': 1764842560.234884, 'auction_closing_time': 1765875600.0}
2025-12-04 10:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3622853') HTTP/1.1" 204 0
2025-12-04 10:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3512008-4007566-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003512008-01990086-001.pdf)
2025-12-04 10:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff0089895-11d9-4c88-a334-4c3a61bc1e9d_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_5.jpg not downloaded yet
2025-12-04 10:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3367441-3989148-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003367441-01971190-003.pdf)
2025-12-04 10:02:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cceda2d0>
2025-12-04 10:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_450fe7de-b611-5eea-a600-69d99fbae57a/450fe7de-b611-5eea-a600-69d99fbae57a_image_17.jpg HTTP/1.1" 201 0
2025-12-04 10:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3512008-4007566-1003.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3512008-4007566-1003.jpg saved to cache
2025-12-04 10:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 450fe7de-b611-5eea-a600-69d99fbae57a
2025-12-04 10:02:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc7f9290>
2025-12-04 10:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_450fe7de-b611-5eea-a600-69d99fbae57a/450fe7de-b611-5eea-a600-69d99fbae57a_image_18.jpg HTTP/1.1" 201 0
2025-12-04 10:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3512008-4007566-1004.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3512008-4007566-1004.jpg saved to cache
2025-12-04 10:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 450fe7de-b611-5eea-a600-69d99fbae57a
2025-12-04 10:02:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc571810>
2025-12-04 10:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ea0b153-3676-5447-9aa2-55baccdf887e/1ea0b153-3676-5447-9aa2-55baccdf887e_image_18.jpg HTTP/1.1" 201 0
2025-12-04 10:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3367441-3989148-1004.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3367441-3989148-1004.jpg saved to cache
2025-12-04 10:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 1ea0b153-3676-5447-9aa2-55baccdf887e
2025-12-04 10:02:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccce6610>
2025-12-04 10:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ea0b153-3676-5447-9aa2-55baccdf887e/1ea0b153-3676-5447-9aa2-55baccdf887e_image_17.jpg HTTP/1.1" 201 0
2025-12-04 10:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3367441-3989148-1003.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3367441-3989148-1003.jpg saved to cache
2025-12-04 10:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 1ea0b153-3676-5447-9aa2-55baccdf887e
2025-12-04 10:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff0089895-11d9-4c88-a334-4c3a61bc1e9d_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_4.jpg not downloaded yet
2025-12-04 10:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff0089895-11d9-4c88-a334-4c3a61bc1e9d_11.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_11.jpg not downloaded yet
2025-12-04 10:02:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd67290>
2025-12-04 10:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_450fe7de-b611-5eea-a600-69d99fbae57a/450fe7de-b611-5eea-a600-69d99fbae57a_image_19.jpg HTTP/1.1" 201 0
2025-12-04 10:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3512008-4007566-1005.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3512008-4007566-1005.jpg saved to cache
2025-12-04 10:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 450fe7de-b611-5eea-a600-69d99fbae57a
2025-12-04 10:02:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd008b90>
2025-12-04 10:02:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ea0b153-3676-5447-9aa2-55baccdf887e/1ea0b153-3676-5447-9aa2-55baccdf887e_image_19.jpg HTTP/1.1" 201 0
2025-12-04 10:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3367441-3989148-1005.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3367441-3989148-1005.jpg saved to cache
2025-12-04 10:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 1ea0b153-3676-5447-9aa2-55baccdf887e
2025-12-04 10:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff0089895-11d9-4c88-a334-4c3a61bc1e9d_10.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_10.jpg not downloaded yet
2025-12-04 10:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/LAND%20ROVER/DISCOVERY?id=3060716&returnUrl=%2Fsearch%3FPage%3D3%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233060716&indx=212> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 10:02:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 10:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3512008-4007566-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003512008-01990086-001.pdf)
2025-12-04 10:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003619601-01984218-001.pdf)
2025-12-04 10:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff0089895-11d9-4c88-a334-4c3a61bc1e9d_9.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_9.jpg not downloaded yet
2025-12-04 10:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003619601-01984218-001.pdf)
2025-12-04 10:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003619601-01984218-001.pdf)
2025-12-04 10:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003619601-01984218-001.pdf)
2025-12-04 10:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003619601-01984218-001.pdf)
2025-12-04 10:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff0089895-11d9-4c88-a334-4c3a61bc1e9d_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_ext_2.jpg not downloaded yet
2025-12-04 10:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff0089895-11d9-4c88-a334-4c3a61bc1e9d_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_ext_5.jpg not downloaded yet
2025-12-04 10:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3367441-3989148-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003367441-01971190-003.pdf)
2025-12-04 10:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff0089895-11d9-4c88-a334-4c3a61bc1e9d_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_ext_3.jpg not downloaded yet
2025-12-04 10:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff0089895-11d9-4c88-a334-4c3a61bc1e9d_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_ext_4.jpg not downloaded yet
2025-12-04 10:02:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f42018c-b167-5adb-8c09-c35c5ecb3c4e with identifier: 3060716
2025-12-04 10:02:42 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 9f42018c-b167-5adb-8c09-c35c5ecb3c4e
2025-12-04 10:02:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccc5c410>
2025-12-04 10:02:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_450fe7de-b611-5eea-a600-69d99fbae57a/450fe7de-b611-5eea-a600-69d99fbae57a_image_16.jpg HTTP/1.1" 201 0
2025-12-04 10:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3512008-4007566-1002.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3512008-4007566-1002.jpg saved to cache
2025-12-04 10:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 450fe7de-b611-5eea-a600-69d99fbae57a
2025-12-04 10:02:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc58d9d0>
2025-12-04 10:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 10:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_4.jpg HTTP/1.1" 201 0
2025-12-04 10:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff0089895-11d9-4c88-a334-4c3a61bc1e9d_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_5.jpg saved to cache
2025-12-04 10:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 86dc784c-fdde-5d03-952a-bfd829c570dc
2025-12-04 10:02:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5919d0>
2025-12-04 10:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_3.jpg HTTP/1.1" 201 0
2025-12-04 10:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff0089895-11d9-4c88-a334-4c3a61bc1e9d_ext_1.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_ext_1.jpg saved to cache
2025-12-04 10:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 86dc784c-fdde-5d03-952a-bfd829c570dc
2025-12-04 10:02:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5959d0>
2025-12-04 10:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_1.jpg HTTP/1.1" 201 0
2025-12-04 10:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff0089895-11d9-4c88-a334-4c3a61bc1e9d_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_ext_7.jpg saved to cache
2025-12-04 10:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 86dc784c-fdde-5d03-952a-bfd829c570dc
2025-12-04 10:02:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce010d0>
2025-12-04 10:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_0.jpg HTTP/1.1" 201 0
2025-12-04 10:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff0089895-11d9-4c88-a334-4c3a61bc1e9d_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_ext_7.jpg saved to cache
2025-12-04 10:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 86dc784c-fdde-5d03-952a-bfd829c570dc
2025-12-04 10:02:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccc5efd0>
2025-12-04 10:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_2.jpg HTTP/1.1" 201 0
2025-12-04 10:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff0089895-11d9-4c88-a334-4c3a61bc1e9d_ext_6.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_ext_6.jpg saved to cache
2025-12-04 10:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 86dc784c-fdde-5d03-952a-bfd829c570dc
2025-12-04 10:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3619601-4002000-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3619601-4002000-13.jpg not downloaded yet
2025-12-04 10:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003619601-01984218-001.pdf)
2025-12-04 10:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3619601-4002000-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3619601-4002000-1000.jpg not downloaded yet
2025-12-04 10:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003619601-01984218-001.pdf)
2025-12-04 10:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003619601-01984218-001.pdf)
2025-12-04 10:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003619601-01984218-001.pdf)
2025-12-04 10:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3512008-4007566-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003512008-01990086-001.pdf)
2025-12-04 10:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3619601-4002000-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3619601-4002000-1001.jpg not downloaded yet
2025-12-04 10:02:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccfcc4d0>
2025-12-04 10:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ea0b153-3676-5447-9aa2-55baccdf887e/1ea0b153-3676-5447-9aa2-55baccdf887e_image_16.jpg HTTP/1.1" 201 0
2025-12-04 10:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3367441-3989148-1002.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3367441-3989148-1002.jpg saved to cache
2025-12-04 10:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 1ea0b153-3676-5447-9aa2-55baccdf887e
2025-12-04 10:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003619601-01984218-001.pdf)
2025-12-04 10:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3367441-3989148-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003367441-01971190-003.pdf)
2025-12-04 10:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3512008-4007566-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003512008-01990086-001.pdf)
2025-12-04 10:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3619601-4002000-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3619601-4002000-1002.jpg not downloaded yet
2025-12-04 10:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3619601-4002000-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3619601-4002000-1003.jpg not downloaded yet
2025-12-04 10:02:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc672450>
2025-12-04 10:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_6.jpg HTTP/1.1" 201 0
2025-12-04 10:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff0089895-11d9-4c88-a334-4c3a61bc1e9d_11.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_11.jpg saved to cache
2025-12-04 10:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 86dc784c-fdde-5d03-952a-bfd829c570dc
2025-12-04 10:02:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce847d0>
2025-12-04 10:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_5.jpg HTTP/1.1" 201 0
2025-12-04 10:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff0089895-11d9-4c88-a334-4c3a61bc1e9d_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_4.jpg saved to cache
2025-12-04 10:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 86dc784c-fdde-5d03-952a-bfd829c570dc
2025-12-04 10:02:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccde9b50>
2025-12-04 10:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_7.jpg HTTP/1.1" 201 0
2025-12-04 10:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff0089895-11d9-4c88-a334-4c3a61bc1e9d_10.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_10.jpg saved to cache
2025-12-04 10:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 86dc784c-fdde-5d03-952a-bfd829c570dc
2025-12-04 10:02:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc7ee290>
2025-12-04 10:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_8.jpg HTTP/1.1" 201 0
2025-12-04 10:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff0089895-11d9-4c88-a334-4c3a61bc1e9d_9.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_9.jpg saved to cache
2025-12-04 10:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 86dc784c-fdde-5d03-952a-bfd829c570dc
2025-12-04 10:02:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6da650>
2025-12-04 10:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_450fe7de-b611-5eea-a600-69d99fbae57a/450fe7de-b611-5eea-a600-69d99fbae57a_image_15.jpg HTTP/1.1" 201 0
2025-12-04 10:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3512008-4007566-1001.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3512008-4007566-1001.jpg saved to cache
2025-12-04 10:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 450fe7de-b611-5eea-a600-69d99fbae57a
2025-12-04 10:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3619601-4002000-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3619601-4002000-1004.jpg not downloaded yet
2025-12-04 10:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3619601-4002000-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003619601-01984218-001.pdf)
2025-12-04 10:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3619601-4002000-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3619601-4002000-1005.jpg not downloaded yet
2025-12-04 10:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003619601-01984218-001.pdf)
2025-12-04 10:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003619601-01984218-001.pdf)
2025-12-04 10:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003619601-01984218-001.pdf)
2025-12-04 10:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3619601-4002000-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003619601-01984218-001.pdf)
2025-12-04 10:02:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cccb8150>
2025-12-04 10:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_9.jpg HTTP/1.1" 201 0
2025-12-04 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff0089895-11d9-4c88-a334-4c3a61bc1e9d_ext_2.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_ext_2.jpg saved to cache
2025-12-04 10:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 86dc784c-fdde-5d03-952a-bfd829c570dc
2025-12-04 10:02:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd105990>
2025-12-04 10:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ea0b153-3676-5447-9aa2-55baccdf887e/1ea0b153-3676-5447-9aa2-55baccdf887e_image_15.jpg HTTP/1.1" 201 0
2025-12-04 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3367441-3989148-1001.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3367441-3989148-1001.jpg saved to cache
2025-12-04 10:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 1ea0b153-3676-5447-9aa2-55baccdf887e
2025-12-04 10:02:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc69b990>
2025-12-04 10:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_450fe7de-b611-5eea-a600-69d99fbae57a/450fe7de-b611-5eea-a600-69d99fbae57a_image_14.jpg HTTP/1.1" 201 0
2025-12-04 10:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3512008-4007566-1000.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3512008-4007566-1000.jpg saved to cache
2025-12-04 10:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 450fe7de-b611-5eea-a600-69d99fbae57a
2025-12-04 10:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3619601-4002000-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003619601-01984218-001.pdf)
2025-12-04 10:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3367441-3989148-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003367441-01971190-003.pdf)
2025-12-04 10:02:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc69c4d0>
2025-12-04 10:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_13.jpg HTTP/1.1" 201 0
2025-12-04 10:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3619601-4002000-13.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3619601-4002000-13.jpg saved to cache
2025-12-04 10:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 86dc784c-fdde-5d03-952a-bfd829c570dc
2025-12-04 10:02:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc572210>
2025-12-04 10:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_12.jpg HTTP/1.1" 201 0
2025-12-04 10:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff0089895-11d9-4c88-a334-4c3a61bc1e9d_ext_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_ext_4.jpg saved to cache
2025-12-04 10:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 86dc784c-fdde-5d03-952a-bfd829c570dc
2025-12-04 10:02:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ce39b310>
2025-12-04 10:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_11.jpg HTTP/1.1" 201 0
2025-12-04 10:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff0089895-11d9-4c88-a334-4c3a61bc1e9d_ext_3.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_ext_3.jpg saved to cache
2025-12-04 10:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 86dc784c-fdde-5d03-952a-bfd829c570dc
2025-12-04 10:02:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cceba310>
2025-12-04 10:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_10.jpg HTTP/1.1" 201 0
2025-12-04 10:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff0089895-11d9-4c88-a334-4c3a61bc1e9d_ext_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_ext_5.jpg saved to cache
2025-12-04 10:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 86dc784c-fdde-5d03-952a-bfd829c570dc
2025-12-04 10:02:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5701d0>
2025-12-04 10:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_15.jpg HTTP/1.1" 201 0
2025-12-04 10:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3619601-4002000-1001.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3619601-4002000-1001.jpg saved to cache
2025-12-04 10:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 86dc784c-fdde-5d03-952a-bfd829c570dc
2025-12-04 10:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3619601-4002000-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003619601-01984218-001.pdf)
2025-12-04 10:02:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf9c710>
2025-12-04 10:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_14.jpg HTTP/1.1" 201 0
2025-12-04 10:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3619601-4002000-1000.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3619601-4002000-1000.jpg saved to cache
2025-12-04 10:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 86dc784c-fdde-5d03-952a-bfd829c570dc
2025-12-04 10:02:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccfbbcd0>
2025-12-04 10:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ea0b153-3676-5447-9aa2-55baccdf887e/1ea0b153-3676-5447-9aa2-55baccdf887e_image_14.jpg HTTP/1.1" 201 0
2025-12-04 10:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3367441-3989148-1000.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3367441-3989148-1000.jpg saved to cache
2025-12-04 10:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 1ea0b153-3676-5447-9aa2-55baccdf887e
2025-12-04 10:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/NISSAN/JUKE?id=3657400&returnUrl=%2Fsearch%3FPage%3D4%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233657400&indx=325> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 10:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3619601-4002000-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003619601-01984218-001.pdf)
2025-12-04 10:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/694f1162-fd52-4da5-a1c2-1fc6a414cdba_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003512008-01990086-001.pdf)
2025-12-04 10:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3512008-4007566-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003512008-01990086-001.pdf)
2025-12-04 10:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3619601-4002000-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003619601-01984218-001.pdf)
2025-12-04 10:02:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc673fd0>
2025-12-04 10:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_18.jpg HTTP/1.1" 201 0
2025-12-04 10:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3619601-4002000-1004.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3619601-4002000-1004.jpg saved to cache
2025-12-04 10:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 86dc784c-fdde-5d03-952a-bfd829c570dc
2025-12-04 10:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3367441-3989148-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003367441-01971190-003.pdf)
2025-12-04 10:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3619601-4002000-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003619601-01984218-001.pdf)
2025-12-04 10:02:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5788230a-dad4-5181-a72c-7c5ccf52b954 with identifier: 3657400
2025-12-04 10:02:50 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 5788230a-dad4-5181-a72c-7c5ccf52b954
2025-12-04 10:02:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc718650>
2025-12-04 10:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_19.jpg HTTP/1.1" 201 0
2025-12-04 10:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3619601-4002000-1005.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3619601-4002000-1005.jpg saved to cache
2025-12-04 10:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 86dc784c-fdde-5d03-952a-bfd829c570dc
2025-12-04 10:02:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd0da290>
2025-12-04 10:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_450fe7de-b611-5eea-a600-69d99fbae57a/450fe7de-b611-5eea-a600-69d99fbae57a_image_12.jpg HTTP/1.1" 201 0
2025-12-04 10:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F694f1162-fd52-4da5-a1c2-1fc6a414cdba_ext_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/694f1162-fd52-4da5-a1c2-1fc6a414cdba_ext_4.jpg saved to cache
2025-12-04 10:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 450fe7de-b611-5eea-a600-69d99fbae57a
2025-12-04 10:02:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6b5e10>
2025-12-04 10:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_450fe7de-b611-5eea-a600-69d99fbae57a/450fe7de-b611-5eea-a600-69d99fbae57a_image_13.jpg HTTP/1.1" 201 0
2025-12-04 10:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3512008-4007566-13.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3512008-4007566-13.jpg saved to cache
2025-12-04 10:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 450fe7de-b611-5eea-a600-69d99fbae57a
2025-12-04 10:02:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6b7890>
2025-12-04 10:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_17.jpg HTTP/1.1" 201 0
2025-12-04 10:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3619601-4002000-1003.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3619601-4002000-1003.jpg saved to cache
2025-12-04 10:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 86dc784c-fdde-5d03-952a-bfd829c570dc
2025-12-04 10:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/79405aed-99b3-44dc-adee-43fe1c1cd635_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003367441-01971190-003.pdf)
2025-12-04 10:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=3637795&returnUrl=%2Fsearch%3FPage%3D4%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233637795&indx=322> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 10:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/GWM%20ORA/03?id=3667925&returnUrl=%2Fsearch%3FPage%3D4%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233667925&indx=331> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 10:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003060716-01984777-003.pdf> (referer: None)
2025-12-04 10:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/694f1162-fd52-4da5-a1c2-1fc6a414cdba_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003512008-01990086-001.pdf)
2025-12-04 10:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/694f1162-fd52-4da5-a1c2-1fc6a414cdba_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003512008-01990086-001.pdf)
2025-12-04 10:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/694f1162-fd52-4da5-a1c2-1fc6a414cdba_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003512008-01990086-001.pdf)
2025-12-04 10:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/79405aed-99b3-44dc-adee-43fe1c1cd635_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003367441-01971190-003.pdf)
2025-12-04 10:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/79405aed-99b3-44dc-adee-43fe1c1cd635_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003367441-01971190-003.pdf)
2025-12-04 10:02:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc63e6d0>
2025-12-04 10:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ea0b153-3676-5447-9aa2-55baccdf887e/1ea0b153-3676-5447-9aa2-55baccdf887e_image_13.jpg HTTP/1.1" 201 0
2025-12-04 10:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3367441-3989148-13.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3367441-3989148-13.jpg saved to cache
2025-12-04 10:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 1ea0b153-3676-5447-9aa2-55baccdf887e
2025-12-04 10:02:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc595250>
2025-12-04 10:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_16.jpg HTTP/1.1" 201 0
2025-12-04 10:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3619601-4002000-1002.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3619601-4002000-1002.jpg saved to cache
2025-12-04 10:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 86dc784c-fdde-5d03-952a-bfd829c570dc
2025-12-04 10:02:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 86dc784c-fdde-5d03-952a-bfd829c570dc, skipping ID generation
2025-12-04 10:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 86dc784c-fdde-5d03-952a-bfd829c570dc from tracking dictionaries
2025-12-04 10:02:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 86dc784c-fdde-5d03-952a-bfd829c570dc sending to next pipeline
2025-12-04 10:02:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 86dc784c-fdde-5d03-952a-bfd829c570dc, identifier: 3619601
2025-12-04 10:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/79405aed-99b3-44dc-adee-43fe1c1cd635_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003367441-01971190-003.pdf)
2025-12-04 10:02:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 86dc784c-fdde-5d03-952a-bfd829c570dc with identifier: 3619601
2025-12-04 10:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-04 10:02:53 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=GREY HTTP/1.1" 200 None
2025-12-04 10:02:53 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-04 10:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-04 10:02:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 86dc784c-fdde-5d03-952a-bfd829c570dc with identifier: 3619601
2025-12-04 10:02:53 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 48, 'seller_name': 'available car', 'price_includes_vat': False, 'title': 'suzuki sx4 1.6 sz5 allgrip 5dr', 'price': 0, 'currency': 'gbp', 'make': 'suzuki', 'model': 'sx4', 'transmission': 'manual', 'engine': '1.6l', 'fuel_type': 'petrol', 'odometer': 137618, 'odometer_reading_unit': 'mi', 'registration_date': '2014-08-07', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/suzuki/sx4?id=3619601', 'location': 'leeds', 'origin_country_code': 'gb', 'trim': '1.6 sz5 allgrip 5dr', 'license_plate': 'py14lzu', 'year': 2014, 'listing': 'directbuy', 'c_o_2_emission_value': 135, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0003619601-01984218-001.pdf', 'expiration_date': '2025-12-08t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': '86dc784c-fdde-5d03-952a-bfd829c570dc', 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_expert_report_file_d67b7120-0f4b-4227-9848-01a93ae7fb82.pdf', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_0.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_ext_7.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 233586}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_1.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_ext_7.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 233586}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_2.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_ext_6.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 241493}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_3.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_ext_1.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 224706}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_4.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_5.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 173611}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_5.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_4.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 200789}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_6.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_11.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 165901}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_7.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_10.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 197343}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_8.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_9.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 204782}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_9.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_ext_2.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 282433}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_10.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_ext_5.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 236518}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_11.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_ext_3.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 248672}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_12.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_ext_4.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 261571}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_13.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3619601-4002000-13.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 399778}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_14.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3619601-4002000-1000.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 354856}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_15.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3619601-4002000-1001.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 256515}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_16.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3619601-4002000-1002.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 416750}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_17.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3619601-4002000-1003.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 196586}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_18.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3619601-4002000-1004.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 385535}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_19.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3619601-4002000-1005.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 174704}], 'current_year_diff': 11, 'age_in_months': 135, 'make_model': 'suzuki sx4', 'sanitized_make': 'suzuki', 'odometer_in_km': 221474}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 135,
     'auction_title': '',
     'c_o_2_emission_value': 135,
     'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_expert_report_file_d67b7120-0f4b-4227-9848-01a93ae7fb82.pdf',
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0003619601-01984218-001.pdf',
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 11,
     'engine': '1.6l',
     'expiration_date': '2025-12-08t09:00:00z',
     'fuel_type': 'petrol',
     'id': '86dc784c-fdde-5d03-952a-bfd829c570dc',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'py14lzu',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/suzuki/sx4?id=3619601',
     'listing': 'directbuy',
     'location': 'leeds',
     'make': 'suzuki',
     'make_model': 'suzuki sx4',
     'model': 'sx4',
     'odometer': 137618,
     'odometer_in_km': 221474,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 48,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 233586,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_ext_7.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 233586,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_ext_7.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 241493,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_ext_6.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 224706,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_ext_1.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 173611,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_5.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 200789,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_4.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 165901,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_11.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 197343,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_10.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 204782,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_9.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 282433,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_ext_2.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 236518,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_ext_5.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 248672,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_ext_3.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 261571,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_ext_4.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 399778,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3619601-4002000-13.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 354856,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3619601-4002000-1000.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_15.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 256515,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3619601-4002000-1001.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_16.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 416750,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3619601-4002000-1002.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_17.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 196586,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3619601-4002000-1003.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_18.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 385535,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3619601-4002000-1004.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_19.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 174704,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3619601-4002000-1005.jpg',
                 'Width': 1333}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2014-08-07',
     'sanitized_make': 'suzuki',
     'seller_name': 'available car',
     'title': 'suzuki sx4 1.6 sz5 allgrip 5dr',
     'transmission': 'manual',
     'trim': '1.6 sz5 allgrip 5dr',
     'year': 2014}
2025-12-04 10:02:53 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 86dc784c-fdde-5d03-952a-bfd829c570dc spider: manheim.gb
2025-12-04 10:02:53 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 86dc784c-fdde-5d03-952a-bfd829c570dc due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 48, 'seller_name': 'available car', 'price_includes_vat': False, 'title': 'suzuki sx4 1.6 sz5 allgrip 5dr', 'price': 0, 'currency': 'gbp', 'make': 'suzuki', 'model': 'sx4', 'transmission': 'manual', 'engine': '1.6l', 'fuel_type': 'petrol', 'odometer': 137618, 'odometer_reading_unit': 'mi', 'registration_date': '2014-08-07', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/suzuki/sx4?id=3619601', 'location': 'leeds', 'origin_country_code': 'gb', 'trim': '1.6 sz5 allgrip 5dr', 'license_plate': 'py14lzu', 'year': 2014, 'listing': 'directbuy', 'c_o_2_emission_value': 135, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0003619601-01984218-001.pdf', 'expiration_date': '2025-12-08t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': '86dc784c-fdde-5d03-952a-bfd829c570dc', 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_expert_report_file_d67b7120-0f4b-4227-9848-01a93ae7fb82.pdf', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_0.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_ext_7.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 233586}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_1.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_ext_7.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 233586}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_2.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_ext_6.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 241493}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_3.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_ext_1.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 224706}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_4.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_5.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 173611}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_5.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_4.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 200789}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_6.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_11.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 165901}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_7.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_10.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 197343}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_8.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_9.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 204782}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_9.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_ext_2.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 282433}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_10.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_ext_5.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 236518}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_11.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_ext_3.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 248672}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_12.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_ext_4.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 261571}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_13.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3619601-4002000-13.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 399778}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_14.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3619601-4002000-1000.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 354856}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_15.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3619601-4002000-1001.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 256515}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_16.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3619601-4002000-1002.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 416750}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_17.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3619601-4002000-1003.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 196586}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_18.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3619601-4002000-1004.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 385535}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_19.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3619601-4002000-1005.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 174704}], 'current_year_diff': 11, 'age_in_months': 135, 'make_model': 'suzuki sx4', 'sanitized_make': 'suzuki', 'odometer_in_km': 221474}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 135,
     'auction_title': '',
     'c_o_2_emission_value': 135,
     'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_expert_report_file_d67b7120-0f4b-4227-9848-01a93ae7fb82.pdf',
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0003619601-01984218-001.pdf',
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 11,
     'engine': '1.6l',
     'expiration_date': '2025-12-08t09:00:00z',
     'fuel_type': 'petrol',
     'id': '86dc784c-fdde-5d03-952a-bfd829c570dc',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'py14lzu',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/suzuki/sx4?id=3619601',
     'listing': 'directbuy',
     'location': 'leeds',
     'make': 'suzuki',
     'make_model': 'suzuki sx4',
     'model': 'sx4',
     'odometer': 137618,
     'odometer_in_km': 221474,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 48,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 233586,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_ext_7.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 233586,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_ext_7.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 241493,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_ext_6.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 224706,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_ext_1.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 173611,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_5.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 200789,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_4.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 165901,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_11.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 197343,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_10.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 204782,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_9.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 282433,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_ext_2.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 236518,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_ext_5.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 248672,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_ext_3.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 261571,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_ext_4.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 399778,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3619601-4002000-13.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 354856,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3619601-4002000-1000.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_15.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 256515,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3619601-4002000-1001.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_16.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 416750,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3619601-4002000-1002.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_17.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 196586,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3619601-4002000-1003.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_18.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 385535,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3619601-4002000-1004.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_19.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 174704,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3619601-4002000-1005.jpg',
                 'Width': 1333}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2014-08-07',
     'sanitized_make': 'suzuki',
     'seller_name': 'available car',
     'title': 'suzuki sx4 1.6 sz5 allgrip 5dr',
     'transmission': 'manual',
     'trim': '1.6 sz5 allgrip 5dr',
     'year': 2014}
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_expert_report_file_d67b7120-0f4b-4227-9848-01a93ae7fb82.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003619601-01984218-001.pdf',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '86dc784c-fdde-5d03-952a-bfd829c570dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'PY14LZU',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/SUZUKI/SX4?id=3619601',
 'listing': 'directbuy',
 'location': 'Leeds',
 'make': 'SUZUKI',
 'model': 'SX4',
 'odometer': 137618,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 48,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 233586,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 233586,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 241493,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 224706,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 173611,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 200789,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 165901,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 197343,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 204782,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 282433,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 236518,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 248672,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 261571,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f0089895-11d9-4c88-a334-4c3a61bc1e9d_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 399778,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3619601-4002000-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 354856,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3619601-4002000-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 256515,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3619601-4002000-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 416750,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3619601-4002000-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 196586,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3619601-4002000-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 385535,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3619601-4002000-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86dc784c-fdde-5d03-952a-bfd829c570dc/86dc784c-fdde-5d03-952a-bfd829c570dc_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 174704,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3619601-4002000-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-08-07',
 'seller_name': 'Available Car',
 'title': 'SUZUKI SX4 1.6 SZ5 ALLGRIP 5dr',
 'transmission': 'manual',
 'trim': '1.6 SZ5 ALLGRIP 5dr',
 'year': 2014}
2025-12-04 10:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273619601%27 HTTP/1.1" 200 None
2025-12-04 10:02:53 [manheim.gb] INFO: Saving data for 3619601: {'created_time': 1764842573.844679, 'last_price_update_time': 1764842573.84469, 'auction_closing_time': 1765184400.0}
2025-12-04 10:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3619601') HTTP/1.1" 204 0
2025-12-04 10:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/694f1162-fd52-4da5-a1c2-1fc6a414cdba_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003512008-01990086-001.pdf)
2025-12-04 10:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/694f1162-fd52-4da5-a1c2-1fc6a414cdba_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003512008-01990086-001.pdf)
2025-12-04 10:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/694f1162-fd52-4da5-a1c2-1fc6a414cdba_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003512008-01990086-001.pdf)
2025-12-04 10:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/694f1162-fd52-4da5-a1c2-1fc6a414cdba_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003512008-01990086-001.pdf)
2025-12-04 10:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/79405aed-99b3-44dc-adee-43fe1c1cd635_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003367441-01971190-003.pdf)
2025-12-04 10:02:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5db590>
2025-12-04 10:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ea0b153-3676-5447-9aa2-55baccdf887e/1ea0b153-3676-5447-9aa2-55baccdf887e_image_12.jpg HTTP/1.1" 201 0
2025-12-04 10:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F79405aed-99b3-44dc-adee-43fe1c1cd635_ext_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/79405aed-99b3-44dc-adee-43fe1c1cd635_ext_4.jpg saved to cache
2025-12-04 10:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 1ea0b153-3676-5447-9aa2-55baccdf887e
2025-12-04 10:02:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf07de31-bff8-5f3c-b42a-e026fbf80708 with identifier: 3637795
2025-12-04 10:02:54 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item cf07de31-bff8-5f3c-b42a-e026fbf80708
2025-12-04 10:02:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 742a8c72-329e-5c3e-ab70-9041f08bc2a7 with identifier: 3667925
2025-12-04 10:02:54 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 742a8c72-329e-5c3e-ab70-9041f08bc2a7
2025-12-04 10:02:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5f0910>
2025-12-04 10:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f42018c-b167-5adb-8c09-c35c5ecb3c4e/9f42018c-b167-5adb-8c09-c35c5ecb3c4e_expert_report_file_a05c32c4-704b-4288-afe9-64d01eb3c7bc.pdf HTTP/1.1" 201 0
2025-12-04 10:02:54 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 9f42018c-b167-5adb-8c09-c35c5ecb3c4e
2025-12-04 10:02:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9f42018c-b167-5adb-8c09-c35c5ecb3c4e, skipping ID generation
2025-12-04 10:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 9f42018c-b167-5adb-8c09-c35c5ecb3c4e
2025-12-04 10:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-2f924e8d-d62a-4a89-a701-41924ecc4d17.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-2f924e8d-d62a-4a89-a701-41924ecc4d17.jpg not downloaded yet
2025-12-04 10:02:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5ea210>
2025-12-04 10:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_450fe7de-b611-5eea-a600-69d99fbae57a/450fe7de-b611-5eea-a600-69d99fbae57a_image_10.jpg HTTP/1.1" 201 0
2025-12-04 10:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F694f1162-fd52-4da5-a1c2-1fc6a414cdba_ext_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/694f1162-fd52-4da5-a1c2-1fc6a414cdba_ext_5.jpg saved to cache
2025-12-04 10:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 450fe7de-b611-5eea-a600-69d99fbae57a
2025-12-04 10:02:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5faa90>
2025-12-04 10:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_450fe7de-b611-5eea-a600-69d99fbae57a/450fe7de-b611-5eea-a600-69d99fbae57a_image_11.jpg HTTP/1.1" 201 0
2025-12-04 10:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F694f1162-fd52-4da5-a1c2-1fc6a414cdba_ext_3.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/694f1162-fd52-4da5-a1c2-1fc6a414cdba_ext_3.jpg saved to cache
2025-12-04 10:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 450fe7de-b611-5eea-a600-69d99fbae57a
2025-12-04 10:02:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5f0fd0>
2025-12-04 10:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_450fe7de-b611-5eea-a600-69d99fbae57a/450fe7de-b611-5eea-a600-69d99fbae57a_image_9.jpg HTTP/1.1" 201 0
2025-12-04 10:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F694f1162-fd52-4da5-a1c2-1fc6a414cdba_ext_2.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/694f1162-fd52-4da5-a1c2-1fc6a414cdba_ext_2.jpg saved to cache
2025-12-04 10:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 450fe7de-b611-5eea-a600-69d99fbae57a
2025-12-04 10:02:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5f8150>
2025-12-04 10:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ea0b153-3676-5447-9aa2-55baccdf887e/1ea0b153-3676-5447-9aa2-55baccdf887e_image_11.jpg HTTP/1.1" 201 0
2025-12-04 10:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F79405aed-99b3-44dc-adee-43fe1c1cd635_ext_3.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/79405aed-99b3-44dc-adee-43fe1c1cd635_ext_3.jpg saved to cache
2025-12-04 10:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 1ea0b153-3676-5447-9aa2-55baccdf887e
2025-12-04 10:02:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd228110>
2025-12-04 10:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ea0b153-3676-5447-9aa2-55baccdf887e/1ea0b153-3676-5447-9aa2-55baccdf887e_image_10.jpg HTTP/1.1" 201 0
2025-12-04 10:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F79405aed-99b3-44dc-adee-43fe1c1cd635_ext_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/79405aed-99b3-44dc-adee-43fe1c1cd635_ext_5.jpg saved to cache
2025-12-04 10:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 1ea0b153-3676-5447-9aa2-55baccdf887e
2025-12-04 10:02:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6b4990>
2025-12-04 10:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ea0b153-3676-5447-9aa2-55baccdf887e/1ea0b153-3676-5447-9aa2-55baccdf887e_image_9.jpg HTTP/1.1" 201 0
2025-12-04 10:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F79405aed-99b3-44dc-adee-43fe1c1cd635_ext_2.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/79405aed-99b3-44dc-adee-43fe1c1cd635_ext_2.jpg saved to cache
2025-12-04 10:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1ea0b153-3676-5447-9aa2-55baccdf887e
2025-12-04 10:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/79405aed-99b3-44dc-adee-43fe1c1cd635_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003367441-01971190-003.pdf)
2025-12-04 10:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/79405aed-99b3-44dc-adee-43fe1c1cd635_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003367441-01971190-003.pdf)
2025-12-04 10:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5e2d86aa-395c-4447-8bf7-70e147db327b_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5e2d86aa-395c-4447-8bf7-70e147db327b_ext_7.jpg not downloaded yet
2025-12-04 10:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/694f1162-fd52-4da5-a1c2-1fc6a414cdba_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003512008-01990086-001.pdf)
2025-12-04 10:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-265d3591-2670-4590-aea2-865ffa36b8b7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-265d3591-2670-4590-aea2-865ffa36b8b7.jpg not downloaded yet
2025-12-04 10:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/79405aed-99b3-44dc-adee-43fe1c1cd635_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003367441-01971190-003.pdf)
2025-12-04 10:02:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce26990>
2025-12-04 10:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_450fe7de-b611-5eea-a600-69d99fbae57a/450fe7de-b611-5eea-a600-69d99fbae57a_image_8.jpg HTTP/1.1" 201 0
2025-12-04 10:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F694f1162-fd52-4da5-a1c2-1fc6a414cdba_9.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/694f1162-fd52-4da5-a1c2-1fc6a414cdba_9.jpg saved to cache
2025-12-04 10:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 450fe7de-b611-5eea-a600-69d99fbae57a
2025-12-04 10:02:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc7dc210>
2025-12-04 10:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_450fe7de-b611-5eea-a600-69d99fbae57a/450fe7de-b611-5eea-a600-69d99fbae57a_image_5.jpg HTTP/1.1" 201 0
2025-12-04 10:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F694f1162-fd52-4da5-a1c2-1fc6a414cdba_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/694f1162-fd52-4da5-a1c2-1fc6a414cdba_4.jpg saved to cache
2025-12-04 10:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 450fe7de-b611-5eea-a600-69d99fbae57a
2025-12-04 10:02:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc7dee50>
2025-12-04 10:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_450fe7de-b611-5eea-a600-69d99fbae57a/450fe7de-b611-5eea-a600-69d99fbae57a_image_7.jpg HTTP/1.1" 201 0
2025-12-04 10:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F694f1162-fd52-4da5-a1c2-1fc6a414cdba_10.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/694f1162-fd52-4da5-a1c2-1fc6a414cdba_10.jpg saved to cache
2025-12-04 10:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 450fe7de-b611-5eea-a600-69d99fbae57a
2025-12-04 10:02:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd48d10>
2025-12-04 10:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_450fe7de-b611-5eea-a600-69d99fbae57a/450fe7de-b611-5eea-a600-69d99fbae57a_image_6.jpg HTTP/1.1" 201 0
2025-12-04 10:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F694f1162-fd52-4da5-a1c2-1fc6a414cdba_11.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/694f1162-fd52-4da5-a1c2-1fc6a414cdba_11.jpg saved to cache
2025-12-04 10:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 450fe7de-b611-5eea-a600-69d99fbae57a
2025-12-04 10:02:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd0da010>
2025-12-04 10:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ea0b153-3676-5447-9aa2-55baccdf887e/1ea0b153-3676-5447-9aa2-55baccdf887e_image_6.jpg HTTP/1.1" 201 0
2025-12-04 10:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F79405aed-99b3-44dc-adee-43fe1c1cd635_11.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/79405aed-99b3-44dc-adee-43fe1c1cd635_11.jpg saved to cache
2025-12-04 10:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1ea0b153-3676-5447-9aa2-55baccdf887e
2025-12-04 10:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-b477366c-59e8-422c-ba41-5bf09207bb35.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-b477366c-59e8-422c-ba41-5bf09207bb35.jpg not downloaded yet
2025-12-04 10:02:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc710310>
2025-12-04 10:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ea0b153-3676-5447-9aa2-55baccdf887e/1ea0b153-3676-5447-9aa2-55baccdf887e_image_7.jpg HTTP/1.1" 201 0
2025-12-04 10:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F79405aed-99b3-44dc-adee-43fe1c1cd635_10.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/79405aed-99b3-44dc-adee-43fe1c1cd635_10.jpg saved to cache
2025-12-04 10:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1ea0b153-3676-5447-9aa2-55baccdf887e
2025-12-04 10:02:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccdf4310>
2025-12-04 10:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ea0b153-3676-5447-9aa2-55baccdf887e/1ea0b153-3676-5447-9aa2-55baccdf887e_image_8.jpg HTTP/1.1" 201 0
2025-12-04 10:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F79405aed-99b3-44dc-adee-43fe1c1cd635_9.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/79405aed-99b3-44dc-adee-43fe1c1cd635_9.jpg saved to cache
2025-12-04 10:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1ea0b153-3676-5447-9aa2-55baccdf887e
2025-12-04 10:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-4a334bed-6c4f-468e-954e-bcbfaa34abd2.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-4a334bed-6c4f-468e-954e-bcbfaa34abd2.jpg not downloaded yet
2025-12-04 10:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/79405aed-99b3-44dc-adee-43fe1c1cd635_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003367441-01971190-003.pdf)
2025-12-04 10:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/79405aed-99b3-44dc-adee-43fe1c1cd635_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003367441-01971190-003.pdf)
2025-12-04 10:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/CITROEN/C3?id=3684908&returnUrl=%2Fsearch%3FPage%3D4%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233684908&indx=338> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 10:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/694f1162-fd52-4da5-a1c2-1fc6a414cdba_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003512008-01990086-001.pdf)
2025-12-04 10:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/694f1162-fd52-4da5-a1c2-1fc6a414cdba_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003512008-01990086-001.pdf)
2025-12-04 10:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/694f1162-fd52-4da5-a1c2-1fc6a414cdba_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003512008-01990086-001.pdf)
2025-12-04 10:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/Img-2f924e8d-d62a-4a89-a701-41924ecc4d17.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003060716-01984777-003.pdf)
2025-12-04 10:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-de389bfc-b38e-49da-8f41-c927fe6c5e16.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-de389bfc-b38e-49da-8f41-c927fe6c5e16.jpg not downloaded yet
2025-12-04 10:02:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccc5e250>
2025-12-04 10:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_450fe7de-b611-5eea-a600-69d99fbae57a/450fe7de-b611-5eea-a600-69d99fbae57a_image_4.jpg HTTP/1.1" 201 0
2025-12-04 10:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F694f1162-fd52-4da5-a1c2-1fc6a414cdba_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/694f1162-fd52-4da5-a1c2-1fc6a414cdba_5.jpg saved to cache
2025-12-04 10:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 450fe7de-b611-5eea-a600-69d99fbae57a
2025-12-04 10:02:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:02:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc56f7d0>
2025-12-04 10:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:02:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ea0b153-3676-5447-9aa2-55baccdf887e/1ea0b153-3676-5447-9aa2-55baccdf887e_image_5.jpg HTTP/1.1" 201 0
2025-12-04 10:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F79405aed-99b3-44dc-adee-43fe1c1cd635_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/79405aed-99b3-44dc-adee-43fe1c1cd635_4.jpg saved to cache
2025-12-04 10:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1ea0b153-3676-5447-9aa2-55baccdf887e
2025-12-04 10:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/79405aed-99b3-44dc-adee-43fe1c1cd635_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003367441-01971190-003.pdf)
2025-12-04 10:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5e2d86aa-395c-4447-8bf7-70e147db327b_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003060716-01984777-003.pdf)
2025-12-04 10:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-368f7401-f46a-4453-a68b-91ea8d5bbf8e.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-368f7401-f46a-4453-a68b-91ea8d5bbf8e.jpg not downloaded yet
2025-12-04 10:03:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccce50d0>
2025-12-04 10:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ea0b153-3676-5447-9aa2-55baccdf887e/1ea0b153-3676-5447-9aa2-55baccdf887e_image_3.jpg HTTP/1.1" 201 0
2025-12-04 10:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F79405aed-99b3-44dc-adee-43fe1c1cd635_ext_1.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/79405aed-99b3-44dc-adee-43fe1c1cd635_ext_1.jpg saved to cache
2025-12-04 10:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1ea0b153-3676-5447-9aa2-55baccdf887e
2025-12-04 10:03:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc53c290>
2025-12-04 10:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ea0b153-3676-5447-9aa2-55baccdf887e/1ea0b153-3676-5447-9aa2-55baccdf887e_image_4.jpg HTTP/1.1" 201 0
2025-12-04 10:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F79405aed-99b3-44dc-adee-43fe1c1cd635_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/79405aed-99b3-44dc-adee-43fe1c1cd635_5.jpg saved to cache
2025-12-04 10:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1ea0b153-3676-5447-9aa2-55baccdf887e
2025-12-04 10:03:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a04449fa-f628-5149-87ae-80a603653269 with identifier: 3684908
2025-12-04 10:03:00 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item a04449fa-f628-5149-87ae-80a603653269
2025-12-04 10:03:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccdf7850>
2025-12-04 10:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_450fe7de-b611-5eea-a600-69d99fbae57a/450fe7de-b611-5eea-a600-69d99fbae57a_image_2.jpg HTTP/1.1" 201 0
2025-12-04 10:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F694f1162-fd52-4da5-a1c2-1fc6a414cdba_ext_6.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/694f1162-fd52-4da5-a1c2-1fc6a414cdba_ext_6.jpg saved to cache
2025-12-04 10:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 450fe7de-b611-5eea-a600-69d99fbae57a
2025-12-04 10:03:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5de950>
2025-12-04 10:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_450fe7de-b611-5eea-a600-69d99fbae57a/450fe7de-b611-5eea-a600-69d99fbae57a_image_3.jpg HTTP/1.1" 201 0
2025-12-04 10:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F694f1162-fd52-4da5-a1c2-1fc6a414cdba_ext_1.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/694f1162-fd52-4da5-a1c2-1fc6a414cdba_ext_1.jpg saved to cache
2025-12-04 10:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 450fe7de-b611-5eea-a600-69d99fbae57a
2025-12-04 10:03:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd035150>
2025-12-04 10:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_450fe7de-b611-5eea-a600-69d99fbae57a/450fe7de-b611-5eea-a600-69d99fbae57a_image_1.jpg HTTP/1.1" 201 0
2025-12-04 10:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F694f1162-fd52-4da5-a1c2-1fc6a414cdba_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/694f1162-fd52-4da5-a1c2-1fc6a414cdba_ext_7.jpg saved to cache
2025-12-04 10:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 450fe7de-b611-5eea-a600-69d99fbae57a
2025-12-04 10:03:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5ddc10>
2025-12-04 10:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f42018c-b167-5adb-8c09-c35c5ecb3c4e/9f42018c-b167-5adb-8c09-c35c5ecb3c4e_image_0.jpg HTTP/1.1" 201 0
2025-12-04 10:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-2f924e8d-d62a-4a89-a701-41924ecc4d17.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-2f924e8d-d62a-4a89-a701-41924ecc4d17.jpg saved to cache
2025-12-04 10:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9f42018c-b167-5adb-8c09-c35c5ecb3c4e
2025-12-04 10:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-fa789e84-2112-46ec-b99a-848e198fbea3.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-fa789e84-2112-46ec-b99a-848e198fbea3.jpg not downloaded yet
2025-12-04 10:03:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd0e84d0>
2025-12-04 10:03:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ea0b153-3676-5447-9aa2-55baccdf887e/1ea0b153-3676-5447-9aa2-55baccdf887e_image_2.jpg HTTP/1.1" 201 0
2025-12-04 10:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F79405aed-99b3-44dc-adee-43fe1c1cd635_ext_6.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/79405aed-99b3-44dc-adee-43fe1c1cd635_ext_6.jpg saved to cache
2025-12-04 10:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1ea0b153-3676-5447-9aa2-55baccdf887e
2025-12-04 10:03:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6d3110>
2025-12-04 10:03:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f42018c-b167-5adb-8c09-c35c5ecb3c4e/9f42018c-b167-5adb-8c09-c35c5ecb3c4e_image_1.jpg HTTP/1.1" 201 0
2025-12-04 10:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5e2d86aa-395c-4447-8bf7-70e147db327b_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5e2d86aa-395c-4447-8bf7-70e147db327b_ext_7.jpg saved to cache
2025-12-04 10:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9f42018c-b167-5adb-8c09-c35c5ecb3c4e
2025-12-04 10:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/Img-3186d138-2acb-442c-b9f0-b2b6a3d8932d.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002606673-01991003-001.pdf)
2025-12-04 10:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-642bbd64-0b79-43b9-955c-da1423b76560.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-642bbd64-0b79-43b9-955c-da1423b76560.jpg not downloaded yet
2025-12-04 10:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/Img-4a334bed-6c4f-468e-954e-bcbfaa34abd2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003060716-01984777-003.pdf)
2025-12-04 10:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/79405aed-99b3-44dc-adee-43fe1c1cd635_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003367441-01971190-003.pdf)
2025-12-04 10:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/Img-b477366c-59e8-422c-ba41-5bf09207bb35.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003060716-01984777-003.pdf)
2025-12-04 10:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/Img-265d3591-2670-4590-aea2-865ffa36b8b7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003060716-01984777-003.pdf)
2025-12-04 10:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/694f1162-fd52-4da5-a1c2-1fc6a414cdba_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003512008-01990086-001.pdf)
2025-12-04 10:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/79405aed-99b3-44dc-adee-43fe1c1cd635_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003367441-01971190-003.pdf)
2025-12-04 10:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-b1af6041-50c0-4844-9783-e56c74676da2.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-b1af6041-50c0-4844-9783-e56c74676da2.jpg not downloaded yet
2025-12-04 10:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/Img-de389bfc-b38e-49da-8f41-c927fe6c5e16.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003060716-01984777-003.pdf)
2025-12-04 10:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-5cc8571f-9b80-466d-aed1-79483aeaf8d9.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-5cc8571f-9b80-466d-aed1-79483aeaf8d9.jpg not downloaded yet
2025-12-04 10:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-6ad0c061-2b75-4079-9bc4-524c2d24ce03.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-6ad0c061-2b75-4079-9bc4-524c2d24ce03.jpg not downloaded yet
2025-12-04 10:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-8c3acb07-0029-4c94-97fb-b6e70223a563.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-8c3acb07-0029-4c94-97fb-b6e70223a563.jpg not downloaded yet
2025-12-04 10:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3060716-3999638-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3060716-3999638-13.jpg not downloaded yet
2025-12-04 10:03:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cceff9d0>
2025-12-04 10:03:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_591f2d53-8462-59fd-a965-443e232a08fb/591f2d53-8462-59fd-a965-443e232a08fb_image_7.jpg HTTP/1.1" 201 0
2025-12-04 10:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-3186d138-2acb-442c-b9f0-b2b6a3d8932d.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-3186d138-2acb-442c-b9f0-b2b6a3d8932d.jpg saved to cache
2025-12-04 10:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 591f2d53-8462-59fd-a965-443e232a08fb
2025-12-04 10:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003657400-01990798-001.pdf> (referer: None)
2025-12-04 10:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3060716-3999638-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3060716-3999638-1000.jpg not downloaded yet
2025-12-04 10:03:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccefe850>
2025-12-04 10:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f42018c-b167-5adb-8c09-c35c5ecb3c4e/9f42018c-b167-5adb-8c09-c35c5ecb3c4e_image_4.jpg HTTP/1.1" 201 0
2025-12-04 10:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-4a334bed-6c4f-468e-954e-bcbfaa34abd2.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-4a334bed-6c4f-468e-954e-bcbfaa34abd2.jpg saved to cache
2025-12-04 10:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9f42018c-b167-5adb-8c09-c35c5ecb3c4e
2025-12-04 10:03:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc53cfd0>
2025-12-04 10:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ea0b153-3676-5447-9aa2-55baccdf887e/1ea0b153-3676-5447-9aa2-55baccdf887e_image_1.jpg HTTP/1.1" 201 0
2025-12-04 10:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F79405aed-99b3-44dc-adee-43fe1c1cd635_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/79405aed-99b3-44dc-adee-43fe1c1cd635_ext_7.jpg saved to cache
2025-12-04 10:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1ea0b153-3676-5447-9aa2-55baccdf887e
2025-12-04 10:03:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc7dce90>
2025-12-04 10:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f42018c-b167-5adb-8c09-c35c5ecb3c4e/9f42018c-b167-5adb-8c09-c35c5ecb3c4e_image_3.jpg HTTP/1.1" 201 0
2025-12-04 10:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-b477366c-59e8-422c-ba41-5bf09207bb35.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-b477366c-59e8-422c-ba41-5bf09207bb35.jpg saved to cache
2025-12-04 10:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9f42018c-b167-5adb-8c09-c35c5ecb3c4e
2025-12-04 10:03:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cceff350>
2025-12-04 10:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f42018c-b167-5adb-8c09-c35c5ecb3c4e/9f42018c-b167-5adb-8c09-c35c5ecb3c4e_image_2.jpg HTTP/1.1" 201 0
2025-12-04 10:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-265d3591-2670-4590-aea2-865ffa36b8b7.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-265d3591-2670-4590-aea2-865ffa36b8b7.jpg saved to cache
2025-12-04 10:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9f42018c-b167-5adb-8c09-c35c5ecb3c4e
2025-12-04 10:03:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce00490>
2025-12-04 10:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_450fe7de-b611-5eea-a600-69d99fbae57a/450fe7de-b611-5eea-a600-69d99fbae57a_image_0.jpg HTTP/1.1" 201 0
2025-12-04 10:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F694f1162-fd52-4da5-a1c2-1fc6a414cdba_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/694f1162-fd52-4da5-a1c2-1fc6a414cdba_ext_7.jpg saved to cache
2025-12-04 10:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 450fe7de-b611-5eea-a600-69d99fbae57a
2025-12-04 10:03:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 450fe7de-b611-5eea-a600-69d99fbae57a, skipping ID generation
2025-12-04 10:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 450fe7de-b611-5eea-a600-69d99fbae57a from tracking dictionaries
2025-12-04 10:03:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 450fe7de-b611-5eea-a600-69d99fbae57a sending to next pipeline
2025-12-04 10:03:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 450fe7de-b611-5eea-a600-69d99fbae57a, identifier: 3512008
2025-12-04 10:03:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc7edb10>
2025-12-04 10:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ea0b153-3676-5447-9aa2-55baccdf887e/1ea0b153-3676-5447-9aa2-55baccdf887e_image_0.jpg HTTP/1.1" 201 0
2025-12-04 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F79405aed-99b3-44dc-adee-43fe1c1cd635_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/79405aed-99b3-44dc-adee-43fe1c1cd635_ext_7.jpg saved to cache
2025-12-04 10:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1ea0b153-3676-5447-9aa2-55baccdf887e
2025-12-04 10:03:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1ea0b153-3676-5447-9aa2-55baccdf887e, skipping ID generation
2025-12-04 10:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 1ea0b153-3676-5447-9aa2-55baccdf887e from tracking dictionaries
2025-12-04 10:03:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1ea0b153-3676-5447-9aa2-55baccdf887e sending to next pipeline
2025-12-04 10:03:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 1ea0b153-3676-5447-9aa2-55baccdf887e, identifier: 3367441
2025-12-04 10:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003667925-01980019-004.pdf> (referer: None)
2025-12-04 10:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/Img-365ae7ee-76b4-428e-b923-2972a12d6cc0.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002606673-01991003-001.pdf)
2025-12-04 10:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/Img-504a4ec2-6285-4511-901a-44a10da763c1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002606673-01991003-001.pdf)
2025-12-04 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3060716-3999638-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3060716-3999638-1001.jpg not downloaded yet
2025-12-04 10:03:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 450fe7de-b611-5eea-a600-69d99fbae57a with identifier: 3512008
2025-12-04 10:03:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 450fe7de-b611-5eea-a600-69d99fbae57a with identifier: 3512008
2025-12-04 10:03:05 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 154847 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    154847
2025-12-04 10:03:05 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 450fe7de-b611-5eea-a600-69d99fbae57a spider: manheim.gb
2025-12-04 10:03:05 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 450fe7de-b611-5eea-a600-69d99fbae57a due to rule: high_mileage_for_country.json, error: 154847 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    154847
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_450fe7de-b611-5eea-a600-69d99fbae57a/450fe7de-b611-5eea-a600-69d99fbae57a_expert_report_file_ea7927dd-788e-4307-a851-d5d4182e3e0e.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003512008-01990086-001.pdf',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '450fe7de-b611-5eea-a600-69d99fbae57a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'KT65MUV',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=3512008',
 'listing': 'auction',
 'location': 'Bristol',
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 96218,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 50,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_450fe7de-b611-5eea-a600-69d99fbae57a/450fe7de-b611-5eea-a600-69d99fbae57a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 201082,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/694f1162-fd52-4da5-a1c2-1fc6a414cdba_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_450fe7de-b611-5eea-a600-69d99fbae57a/450fe7de-b611-5eea-a600-69d99fbae57a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 201082,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/694f1162-fd52-4da5-a1c2-1fc6a414cdba_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_450fe7de-b611-5eea-a600-69d99fbae57a/450fe7de-b611-5eea-a600-69d99fbae57a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 221656,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/694f1162-fd52-4da5-a1c2-1fc6a414cdba_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_450fe7de-b611-5eea-a600-69d99fbae57a/450fe7de-b611-5eea-a600-69d99fbae57a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 234415,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/694f1162-fd52-4da5-a1c2-1fc6a414cdba_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_450fe7de-b611-5eea-a600-69d99fbae57a/450fe7de-b611-5eea-a600-69d99fbae57a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 161458,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/694f1162-fd52-4da5-a1c2-1fc6a414cdba_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_450fe7de-b611-5eea-a600-69d99fbae57a/450fe7de-b611-5eea-a600-69d99fbae57a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 186073,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/694f1162-fd52-4da5-a1c2-1fc6a414cdba_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_450fe7de-b611-5eea-a600-69d99fbae57a/450fe7de-b611-5eea-a600-69d99fbae57a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 165951,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/694f1162-fd52-4da5-a1c2-1fc6a414cdba_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_450fe7de-b611-5eea-a600-69d99fbae57a/450fe7de-b611-5eea-a600-69d99fbae57a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 179752,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/694f1162-fd52-4da5-a1c2-1fc6a414cdba_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_450fe7de-b611-5eea-a600-69d99fbae57a/450fe7de-b611-5eea-a600-69d99fbae57a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 182980,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/694f1162-fd52-4da5-a1c2-1fc6a414cdba_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_450fe7de-b611-5eea-a600-69d99fbae57a/450fe7de-b611-5eea-a600-69d99fbae57a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 193046,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/694f1162-fd52-4da5-a1c2-1fc6a414cdba_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_450fe7de-b611-5eea-a600-69d99fbae57a/450fe7de-b611-5eea-a600-69d99fbae57a_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 187245,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/694f1162-fd52-4da5-a1c2-1fc6a414cdba_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_450fe7de-b611-5eea-a600-69d99fbae57a/450fe7de-b611-5eea-a600-69d99fbae57a_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 189547,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/694f1162-fd52-4da5-a1c2-1fc6a414cdba_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_450fe7de-b611-5eea-a600-69d99fbae57a/450fe7de-b611-5eea-a600-69d99fbae57a_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 146036,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/694f1162-fd52-4da5-a1c2-1fc6a414cdba_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_450fe7de-b611-5eea-a600-69d99fbae57a/450fe7de-b611-5eea-a600-69d99fbae57a_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 260159,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3512008-4007566-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_450fe7de-b611-5eea-a600-69d99fbae57a/450fe7de-b611-5eea-a600-69d99fbae57a_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 366789,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3512008-4007566-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_450fe7de-b611-5eea-a600-69d99fbae57a/450fe7de-b611-5eea-a600-69d99fbae57a_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 260273,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3512008-4007566-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_450fe7de-b611-5eea-a600-69d99fbae57a/450fe7de-b611-5eea-a600-69d99fbae57a_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 187577,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3512008-4007566-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_450fe7de-b611-5eea-a600-69d99fbae57a/450fe7de-b611-5eea-a600-69d99fbae57a_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 211561,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3512008-4007566-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_450fe7de-b611-5eea-a600-69d99fbae57a/450fe7de-b611-5eea-a600-69d99fbae57a_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 240634,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3512008-4007566-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_450fe7de-b611-5eea-a600-69d99fbae57a/450fe7de-b611-5eea-a600-69d99fbae57a_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 372598,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3512008-4007566-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-01',
 'seller_name': 'Wessex Garages',
 'title': 'NISSAN QASHQAI 1.2 DiG-T N-Tec 5dr',
 'transmission': 'manual',
 'trim': '1.2 DiG-T N-Tec 5dr',
 'year': 2016}
2025-12-04 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273512008%27 HTTP/1.1" 200 None
2025-12-04 10:03:05 [manheim.gb] INFO: Saving data for 3512008: {'created_time': 1764842585.841915, 'last_price_update_time': 1764842585.84193, 'auction_closing_time': 1765184400.0}
2025-12-04 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3512008') HTTP/1.1" 204 0
2025-12-04 10:03:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 1ea0b153-3676-5447-9aa2-55baccdf887e with identifier: 3367441
2025-12-04 10:03:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 1ea0b153-3676-5447-9aa2-55baccdf887e with identifier: 3367441
2025-12-04 10:03:05 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 1ea0b153-3676-5447-9aa2-55baccdf887e with identifier: 3367441 to the API
2025-12-04 10:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 10:03:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 10:03:06 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/79405aed-99b3-44dc-adee-43fe1c1cd635_ext_7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ea0b153-3676-5447-9aa2-55baccdf887e/1ea0b153-3676-5447-9aa2-55baccdf887e_expert_report_file_44722bf9-70e9-49fb-a2ff-a495c7605729.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003367441-01971190-003.pdf',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '1.5L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '1ea0b153-3676-5447-9aa2-55baccdf887e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'YM70KEJ',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FORD/KUGA?id=3367441',
 'listing': 'auction',
 'location': 'Leeds - In Transit',
 'make': 'FORD',
 'model': 'KUGA',
 'odometer': 46613,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 71,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ea0b153-3676-5447-9aa2-55baccdf887e/1ea0b153-3676-5447-9aa2-55baccdf887e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 196672,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/79405aed-99b3-44dc-adee-43fe1c1cd635_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ea0b153-3676-5447-9aa2-55baccdf887e/1ea0b153-3676-5447-9aa2-55baccdf887e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 196672,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/79405aed-99b3-44dc-adee-43fe1c1cd635_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ea0b153-3676-5447-9aa2-55baccdf887e/1ea0b153-3676-5447-9aa2-55baccdf887e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 279198,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/79405aed-99b3-44dc-adee-43fe1c1cd635_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ea0b153-3676-5447-9aa2-55baccdf887e/1ea0b153-3676-5447-9aa2-55baccdf887e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 138816,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/79405aed-99b3-44dc-adee-43fe1c1cd635_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ea0b153-3676-5447-9aa2-55baccdf887e/1ea0b153-3676-5447-9aa2-55baccdf887e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 193401,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/79405aed-99b3-44dc-adee-43fe1c1cd635_5.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ea0b153-3676-5447-9aa2-55baccdf887e/1ea0b153-3676-5447-9aa2-55baccdf887e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 202060,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/79405aed-99b3-44dc-adee-43fe1c1cd635_4.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ea0b153-3676-5447-9aa2-55baccdf887e/1ea0b153-3676-5447-9aa2-55baccdf887e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 191125,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/79405aed-99b3-44dc-adee-43fe1c1cd635_11.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ea0b153-3676-5447-9aa2-55baccdf887e/1ea0b153-3676-5447-9aa2-55baccdf887e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 201258,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/79405aed-99b3-44dc-adee-43fe1c1cd635_10.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ea0b153-3676-5447-9aa2-55baccdf887e/1ea0b153-3676-5447-9aa2-55baccdf887e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 211090,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/79405aed-99b3-44dc-adee-43fe1c1cd635_9.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ea0b153-3676-5447-9aa2-55baccdf887e/1ea0b153-3676-5447-9aa2-55baccdf887e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 269030,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/79405aed-99b3-44dc-adee-43fe1c1cd635_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ea0b153-3676-5447-9aa2-55baccdf887e/1ea0b153-3676-5447-9aa2-55baccdf887e_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 246349,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/79405aed-99b3-44dc-adee-43fe1c1cd635_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ea0b153-3676-5447-9aa2-55baccdf887e/1ea0b153-3676-5447-9aa2-55baccdf887e_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 222425,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/79405aed-99b3-44dc-adee-43fe1c1cd635_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ea0b153-3676-5447-9aa2-55baccdf887e/1ea0b153-3676-5447-9aa2-55baccdf887e_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 272974,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/79405aed-99b3-44dc-adee-43fe1c1cd635_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ea0b153-3676-5447-9aa2-55baccdf887e/1ea0b153-3676-5447-9aa2-55baccdf887e_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 363290,
             'Height': 843,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3367441-3989148-13.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ea0b153-3676-5447-9aa2-55baccdf887e/1ea0b153-3676-5447-9aa2-55baccdf887e_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 351790,
             'Height': 843,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3367441-3989148-1000.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ea0b153-3676-5447-9aa2-55baccdf887e/1ea0b153-3676-5447-9aa2-55baccdf887e_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 391229,
             'Height': 843,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3367441-3989148-1001.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ea0b153-3676-5447-9aa2-55baccdf887e/1ea0b153-3676-5447-9aa2-55baccdf887e_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 476670,
             'Height': 843,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3367441-3989148-1002.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ea0b153-3676-5447-9aa2-55baccdf887e/1ea0b153-3676-5447-9aa2-55baccdf887e_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 271299,
             'Height': 843,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3367441-3989148-1003.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ea0b153-3676-5447-9aa2-55baccdf887e/1ea0b153-3676-5447-9aa2-55baccdf887e_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 261595,
             'Height': 843,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3367441-3989148-1004.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ea0b153-3676-5447-9aa2-55baccdf887e/1ea0b153-3676-5447-9aa2-55baccdf887e_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 490135,
             'Height': 843,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3367441-3989148-1005.jpg',
             'Width': 1500}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-31',
 'seller_name': 'Novuna Vehicle Solutions',
 'title': 'FORD KUGA 1.5 EcoBlue ST-Line X Edition 5dr',
 'transmission': 'manual',
 'trim': '1.5 EcoBlue ST-Line X Edition 5dr',
 'year': 2020}
2025-12-04 10:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273367441%27 HTTP/1.1" 200 None
2025-12-04 10:03:06 [manheim.gb] INFO: Saving data for 3367441: {'created_time': 1764842586.437346, 'last_price_update_time': 1764842586.437357, 'auction_closing_time': 1765184400.0}
2025-12-04 10:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3367441') HTTP/1.1" 204 0
2025-12-04 10:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/Img-368f7401-f46a-4453-a68b-91ea8d5bbf8e.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003060716-01984777-003.pdf)
2025-12-04 10:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/Img-fa789e84-2112-46ec-b99a-848e198fbea3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003060716-01984777-003.pdf)
2025-12-04 10:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/Img-642bbd64-0b79-43b9-955c-da1423b76560.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003060716-01984777-003.pdf)
2025-12-04 10:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3060716-3999638-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3060716-3999638-1002.jpg not downloaded yet
2025-12-04 10:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/CITROEN/C3?id=3684907&returnUrl=%2Fsearch%3FPage%3D4%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233684907&indx=337> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 10:03:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd82390>
2025-12-04 10:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f42018c-b167-5adb-8c09-c35c5ecb3c4e/9f42018c-b167-5adb-8c09-c35c5ecb3c4e_image_5.jpg HTTP/1.1" 201 0
2025-12-04 10:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-de389bfc-b38e-49da-8f41-c927fe6c5e16.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-de389bfc-b38e-49da-8f41-c927fe6c5e16.jpg saved to cache
2025-12-04 10:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9f42018c-b167-5adb-8c09-c35c5ecb3c4e
2025-12-04 10:03:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd80e90>
2025-12-04 10:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5788230a-dad4-5181-a72c-7c5ccf52b954/5788230a-dad4-5181-a72c-7c5ccf52b954_expert_report_file_4545803a-e449-4bfd-8e4b-a0fa510e2042.pdf HTTP/1.1" 201 0
2025-12-04 10:03:07 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 5788230a-dad4-5181-a72c-7c5ccf52b954
2025-12-04 10:03:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5788230a-dad4-5181-a72c-7c5ccf52b954, skipping ID generation
2025-12-04 10:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 5788230a-dad4-5181-a72c-7c5ccf52b954
2025-12-04 10:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4e0f13bc-e8b8-41f6-aeda-db604f626472_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4e0f13bc-e8b8-41f6-aeda-db604f626472_ext_7.jpg not downloaded yet
2025-12-04 10:03:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/Img-b1af6041-50c0-4844-9783-e56c74676da2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003060716-01984777-003.pdf)
2025-12-04 10:03:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/Img-af5ba8d6-b869-47dd-8a04-4395a99d3b3e.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002606673-01991003-001.pdf)
2025-12-04 10:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3060716-3999638-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3060716-3999638-1003.jpg not downloaded yet
2025-12-04 10:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4e0f13bc-e8b8-41f6-aeda-db604f626472_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4e0f13bc-e8b8-41f6-aeda-db604f626472_ext_7.jpg not downloaded yet
2025-12-04 10:03:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc69aa90>
2025-12-04 10:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_expert_report_file_f9ff82fc-1644-4bbf-b350-b4232efe3a02.pdf HTTP/1.1" 201 0
2025-12-04 10:03:07 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 742a8c72-329e-5c3e-ab70-9041f08bc2a7
2025-12-04 10:03:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 742a8c72-329e-5c3e-ab70-9041f08bc2a7, skipping ID generation
2025-12-04 10:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 19 photos for item 742a8c72-329e-5c3e-ab70-9041f08bc2a7
2025-12-04 10:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7771ef22-bf10-41ca-8823-6cd0d55ba8c1_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_ext_7.jpg not downloaded yet
2025-12-04 10:03:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cceb1d90>
2025-12-04 10:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_591f2d53-8462-59fd-a965-443e232a08fb/591f2d53-8462-59fd-a965-443e232a08fb_image_5.jpg HTTP/1.1" 201 0
2025-12-04 10:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-365ae7ee-76b4-428e-b923-2972a12d6cc0.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-365ae7ee-76b4-428e-b923-2972a12d6cc0.jpg saved to cache
2025-12-04 10:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 591f2d53-8462-59fd-a965-443e232a08fb
2025-12-04 10:03:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6f2750>
2025-12-04 10:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_591f2d53-8462-59fd-a965-443e232a08fb/591f2d53-8462-59fd-a965-443e232a08fb_image_4.jpg HTTP/1.1" 201 0
2025-12-04 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-504a4ec2-6285-4511-901a-44a10da763c1.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-504a4ec2-6285-4511-901a-44a10da763c1.jpg saved to cache
2025-12-04 10:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 591f2d53-8462-59fd-a965-443e232a08fb
2025-12-04 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3060716-3999638-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3060716-3999638-1004.jpg not downloaded yet
2025-12-04 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4e0f13bc-e8b8-41f6-aeda-db604f626472_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4e0f13bc-e8b8-41f6-aeda-db604f626472_ext_6.jpg not downloaded yet
2025-12-04 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7771ef22-bf10-41ca-8823-6cd0d55ba8c1_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_ext_7.jpg not downloaded yet
2025-12-04 10:03:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc7e1290>
2025-12-04 10:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f42018c-b167-5adb-8c09-c35c5ecb3c4e/9f42018c-b167-5adb-8c09-c35c5ecb3c4e_image_6.jpg HTTP/1.1" 201 0
2025-12-04 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-368f7401-f46a-4453-a68b-91ea8d5bbf8e.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-368f7401-f46a-4453-a68b-91ea8d5bbf8e.jpg saved to cache
2025-12-04 10:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9f42018c-b167-5adb-8c09-c35c5ecb3c4e
2025-12-04 10:03:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccc8ed50>
2025-12-04 10:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f42018c-b167-5adb-8c09-c35c5ecb3c4e/9f42018c-b167-5adb-8c09-c35c5ecb3c4e_image_7.jpg HTTP/1.1" 201 0
2025-12-04 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-fa789e84-2112-46ec-b99a-848e198fbea3.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-fa789e84-2112-46ec-b99a-848e198fbea3.jpg saved to cache
2025-12-04 10:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9f42018c-b167-5adb-8c09-c35c5ecb3c4e
2025-12-04 10:03:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccefd550>
2025-12-04 10:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f42018c-b167-5adb-8c09-c35c5ecb3c4e/9f42018c-b167-5adb-8c09-c35c5ecb3c4e_image_8.jpg HTTP/1.1" 201 0
2025-12-04 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-642bbd64-0b79-43b9-955c-da1423b76560.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-642bbd64-0b79-43b9-955c-da1423b76560.jpg saved to cache
2025-12-04 10:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9f42018c-b167-5adb-8c09-c35c5ecb3c4e
2025-12-04 10:03:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa with identifier: 3684907
2025-12-04 10:03:09 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa
2025-12-04 10:03:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd106110>
2025-12-04 10:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f42018c-b167-5adb-8c09-c35c5ecb3c4e/9f42018c-b167-5adb-8c09-c35c5ecb3c4e_image_9.jpg HTTP/1.1" 201 0
2025-12-04 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-b1af6041-50c0-4844-9783-e56c74676da2.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-b1af6041-50c0-4844-9783-e56c74676da2.jpg saved to cache
2025-12-04 10:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9f42018c-b167-5adb-8c09-c35c5ecb3c4e
2025-12-04 10:03:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd228110>
2025-12-04 10:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_591f2d53-8462-59fd-a965-443e232a08fb/591f2d53-8462-59fd-a965-443e232a08fb_image_6.jpg HTTP/1.1" 201 0
2025-12-04 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-af5ba8d6-b869-47dd-8a04-4395a99d3b3e.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-af5ba8d6-b869-47dd-8a04-4395a99d3b3e.jpg saved to cache
2025-12-04 10:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 591f2d53-8462-59fd-a965-443e232a08fb
2025-12-04 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3060716-3999638-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3060716-3999638-1005.jpg not downloaded yet
2025-12-04 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4e0f13bc-e8b8-41f6-aeda-db604f626472_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4e0f13bc-e8b8-41f6-aeda-db604f626472_ext_1.jpg not downloaded yet
2025-12-04 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7771ef22-bf10-41ca-8823-6cd0d55ba8c1_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_ext_6.jpg not downloaded yet
2025-12-04 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4e0f13bc-e8b8-41f6-aeda-db604f626472_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4e0f13bc-e8b8-41f6-aeda-db604f626472_5.jpg not downloaded yet
2025-12-04 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7771ef22-bf10-41ca-8823-6cd0d55ba8c1_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_ext_1.jpg not downloaded yet
2025-12-04 10:03:09 [scrapy.core.engine] DEBUG: Crawled (404) <GET https://www.manheim.co.uk/vehicle-detail/NISSAN/JUKE?id=3678294&returnUrl=%2Fsearch%3FPage%3D4%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233678294&indx=334> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 10:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003637795-01992770-001.pdf> (referer: None)
2025-12-04 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4e0f13bc-e8b8-41f6-aeda-db604f626472_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4e0f13bc-e8b8-41f6-aeda-db604f626472_4.jpg not downloaded yet
2025-12-04 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7771ef22-bf10-41ca-8823-6cd0d55ba8c1_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_5.jpg not downloaded yet
2025-12-04 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4e0f13bc-e8b8-41f6-aeda-db604f626472_11.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4e0f13bc-e8b8-41f6-aeda-db604f626472_11.jpg not downloaded yet
2025-12-04 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7771ef22-bf10-41ca-8823-6cd0d55ba8c1_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_4.jpg not downloaded yet
2025-12-04 10:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4e0f13bc-e8b8-41f6-aeda-db604f626472_10.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4e0f13bc-e8b8-41f6-aeda-db604f626472_10.jpg not downloaded yet
2025-12-04 10:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7771ef22-bf10-41ca-8823-6cd0d55ba8c1_11.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_11.jpg not downloaded yet
2025-12-04 10:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003684908-01971828-004.pdf> (referer: None)
2025-12-04 10:03:10 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Ignoring non-200 response
NoneType: None
2025-12-04 10:03:10 [scrapy.core.scraper] ERROR: Spider error processing <GET https://www.manheim.co.uk/vehicle-detail/NISSAN/JUKE?id=3678294&returnUrl=%2Fsearch%3FPage%3D4%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233678294&indx=334> (referer: https://www.manheim.co.uk/search/refine)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 301, in process_spider_exception
    return self._process_spider_exception(response, spider, _failure)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/httperror.py", line 46, in process_spider_input
    raise HttpError(response, "Ignoring non-200 response")
scrapy.spidermiddlewares.httperror.HttpError: Ignoring non-200 response
2025-12-04 10:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4e0f13bc-e8b8-41f6-aeda-db604f626472_9.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4e0f13bc-e8b8-41f6-aeda-db604f626472_9.jpg not downloaded yet
2025-12-04 10:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7771ef22-bf10-41ca-8823-6cd0d55ba8c1_10.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_10.jpg not downloaded yet
2025-12-04 10:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4e0f13bc-e8b8-41f6-aeda-db604f626472_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4e0f13bc-e8b8-41f6-aeda-db604f626472_ext_2.jpg not downloaded yet
2025-12-04 10:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7771ef22-bf10-41ca-8823-6cd0d55ba8c1_9.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_9.jpg not downloaded yet
2025-12-04 10:03:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc53c590>
2025-12-04 10:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf07de31-bff8-5f3c-b42a-e026fbf80708/cf07de31-bff8-5f3c-b42a-e026fbf80708_expert_report_file_28f8df50-61e4-4421-941e-4ee3852458da.pdf HTTP/1.1" 201 0
2025-12-04 10:03:10 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item cf07de31-bff8-5f3c-b42a-e026fbf80708
2025-12-04 10:03:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cf07de31-bff8-5f3c-b42a-e026fbf80708, skipping ID generation
2025-12-04 10:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item cf07de31-bff8-5f3c-b42a-e026fbf80708
2025-12-04 10:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Facb2ad77-4d07-4c83-8597-4ef78a2468db_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/acb2ad77-4d07-4c83-8597-4ef78a2468db_ext_7.jpg not downloaded yet
2025-12-04 10:03:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce853d0>
2025-12-04 10:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a04449fa-f628-5149-87ae-80a603653269/a04449fa-f628-5149-87ae-80a603653269_expert_report_file_f47d4d2c-f5d5-4f7c-ba9a-b63aacfeaeff.pdf HTTP/1.1" 201 0
2025-12-04 10:03:11 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item a04449fa-f628-5149-87ae-80a603653269
2025-12-04 10:03:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a04449fa-f628-5149-87ae-80a603653269, skipping ID generation
2025-12-04 10:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item a04449fa-f628-5149-87ae-80a603653269
2025-12-04 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb9aaeec9-105e-4441-a7c5-765a5765a11a_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b9aaeec9-105e-4441-a7c5-765a5765a11a_ext_7.jpg already downloaded
2025-12-04 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb9aaeec9-105e-4441-a7c5-765a5765a11a_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b9aaeec9-105e-4441-a7c5-765a5765a11a_ext_7.jpg already downloaded
2025-12-04 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb9aaeec9-105e-4441-a7c5-765a5765a11a_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b9aaeec9-105e-4441-a7c5-765a5765a11a_ext_6.jpg already downloaded
2025-12-04 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb9aaeec9-105e-4441-a7c5-765a5765a11a_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b9aaeec9-105e-4441-a7c5-765a5765a11a_ext_1.jpg already downloaded
2025-12-04 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb9aaeec9-105e-4441-a7c5-765a5765a11a_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b9aaeec9-105e-4441-a7c5-765a5765a11a_5.jpg already downloaded
2025-12-04 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb9aaeec9-105e-4441-a7c5-765a5765a11a_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b9aaeec9-105e-4441-a7c5-765a5765a11a_4.jpg already downloaded
2025-12-04 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb9aaeec9-105e-4441-a7c5-765a5765a11a_11.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b9aaeec9-105e-4441-a7c5-765a5765a11a_11.jpg already downloaded
2025-12-04 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb9aaeec9-105e-4441-a7c5-765a5765a11a_10.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b9aaeec9-105e-4441-a7c5-765a5765a11a_10.jpg already downloaded
2025-12-04 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb9aaeec9-105e-4441-a7c5-765a5765a11a_9.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b9aaeec9-105e-4441-a7c5-765a5765a11a_9.jpg already downloaded
2025-12-04 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb9aaeec9-105e-4441-a7c5-765a5765a11a_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b9aaeec9-105e-4441-a7c5-765a5765a11a_ext_2.jpg already downloaded
2025-12-04 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb9aaeec9-105e-4441-a7c5-765a5765a11a_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b9aaeec9-105e-4441-a7c5-765a5765a11a_ext_5.jpg already downloaded
2025-12-04 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb9aaeec9-105e-4441-a7c5-765a5765a11a_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b9aaeec9-105e-4441-a7c5-765a5765a11a_ext_3.jpg already downloaded
2025-12-04 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb9aaeec9-105e-4441-a7c5-765a5765a11a_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b9aaeec9-105e-4441-a7c5-765a5765a11a_ext_4.jpg already downloaded
2025-12-04 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3684908-3984090-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3684908-3984090-13.jpg already downloaded
2025-12-04 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3684908-3984090-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3684908-3984090-1000.jpg already downloaded
2025-12-04 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3684908-3984090-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3684908-3984090-1001.jpg already downloaded
2025-12-04 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3684908-3984090-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3684908-3984090-1002.jpg already downloaded
2025-12-04 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3684908-3984090-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3684908-3984090-1003.jpg already downloaded
2025-12-04 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3684908-3984090-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3684908-3984090-1004.jpg already downloaded
2025-12-04 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3684908-3984090-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3684908-3984090-1005.jpg already downloaded
2025-12-04 10:03:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: a04449fa-f628-5149-87ae-80a603653269, identifier: 3684908
2025-12-04 10:03:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: a04449fa-f628-5149-87ae-80a603653269 with identifier: 3684908
2025-12-04 10:03:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: a04449fa-f628-5149-87ae-80a603653269 with identifier: 3684908
2025-12-04 10:03:11 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: a04449fa-f628-5149-87ae-80a603653269 with identifier: 3684908 to the API
2025-12-04 10:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 10:03:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 10:03:12 [scrapy.core.scraper] DEBUG: Scraped from <200 http://ecr.manheim.co.uk/pdf/MOL-0003684908-01971828-004.pdf>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a04449fa-f628-5149-87ae-80a603653269/a04449fa-f628-5149-87ae-80a603653269_expert_report_file_f47d4d2c-f5d5-4f7c-ba9a-b63aacfeaeff.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003684908-01971828-004.pdf',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'a04449fa-f628-5149-87ae-80a603653269',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'BT73JBO',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/CITROEN/C3?id=3684908',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'CITROEN',
 'model': 'C3',
 'odometer': 10290,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 20,
 'photo_urls': ['http://images.manheim.co.uk/images/units/zoom/b9aaeec9-105e-4441-a7c5-765a5765a11a_ext_7.jpg',
                'http://images.manheim.co.uk/images/units/zoom/b9aaeec9-105e-4441-a7c5-765a5765a11a_ext_7.jpg',
                'http://images.manheim.co.uk/images/units/zoom/b9aaeec9-105e-4441-a7c5-765a5765a11a_ext_6.jpg',
                'http://images.manheim.co.uk/images/units/zoom/b9aaeec9-105e-4441-a7c5-765a5765a11a_ext_1.jpg',
                'http://images.manheim.co.uk/images/units/zoom/b9aaeec9-105e-4441-a7c5-765a5765a11a_5.jpg',
                'http://images.manheim.co.uk/images/units/zoom/b9aaeec9-105e-4441-a7c5-765a5765a11a_4.jpg',
                'http://images.manheim.co.uk/images/units/zoom/b9aaeec9-105e-4441-a7c5-765a5765a11a_11.jpg',
                'http://images.manheim.co.uk/images/units/zoom/b9aaeec9-105e-4441-a7c5-765a5765a11a_10.jpg',
                'http://images.manheim.co.uk/images/units/zoom/b9aaeec9-105e-4441-a7c5-765a5765a11a_9.jpg',
                'http://images.manheim.co.uk/images/units/zoom/b9aaeec9-105e-4441-a7c5-765a5765a11a_ext_2.jpg',
                'http://images.manheim.co.uk/images/units/zoom/b9aaeec9-105e-4441-a7c5-765a5765a11a_ext_5.jpg',
                'http://images.manheim.co.uk/images/units/zoom/b9aaeec9-105e-4441-a7c5-765a5765a11a_ext_3.jpg',
                'http://images.manheim.co.uk/images/units/zoom/b9aaeec9-105e-4441-a7c5-765a5765a11a_ext_4.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3684908-3984090-13.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3684908-3984090-1000.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3684908-3984090-1001.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3684908-3984090-1002.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3684908-3984090-1003.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3684908-3984090-1004.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3684908-3984090-1005.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a04449fa-f628-5149-87ae-80a603653269/a04449fa-f628-5149-87ae-80a603653269_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 173246,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b9aaeec9-105e-4441-a7c5-765a5765a11a_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a04449fa-f628-5149-87ae-80a603653269/a04449fa-f628-5149-87ae-80a603653269_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 173246,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b9aaeec9-105e-4441-a7c5-765a5765a11a_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a04449fa-f628-5149-87ae-80a603653269/a04449fa-f628-5149-87ae-80a603653269_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 276312,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b9aaeec9-105e-4441-a7c5-765a5765a11a_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a04449fa-f628-5149-87ae-80a603653269/a04449fa-f628-5149-87ae-80a603653269_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 144277,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b9aaeec9-105e-4441-a7c5-765a5765a11a_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a04449fa-f628-5149-87ae-80a603653269/a04449fa-f628-5149-87ae-80a603653269_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 163192,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b9aaeec9-105e-4441-a7c5-765a5765a11a_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a04449fa-f628-5149-87ae-80a603653269/a04449fa-f628-5149-87ae-80a603653269_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 163445,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b9aaeec9-105e-4441-a7c5-765a5765a11a_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a04449fa-f628-5149-87ae-80a603653269/a04449fa-f628-5149-87ae-80a603653269_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 160392,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b9aaeec9-105e-4441-a7c5-765a5765a11a_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a04449fa-f628-5149-87ae-80a603653269/a04449fa-f628-5149-87ae-80a603653269_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 152235,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b9aaeec9-105e-4441-a7c5-765a5765a11a_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a04449fa-f628-5149-87ae-80a603653269/a04449fa-f628-5149-87ae-80a603653269_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 164635,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b9aaeec9-105e-4441-a7c5-765a5765a11a_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a04449fa-f628-5149-87ae-80a603653269/a04449fa-f628-5149-87ae-80a603653269_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 321326,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b9aaeec9-105e-4441-a7c5-765a5765a11a_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a04449fa-f628-5149-87ae-80a603653269/a04449fa-f628-5149-87ae-80a603653269_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 336396,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b9aaeec9-105e-4441-a7c5-765a5765a11a_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a04449fa-f628-5149-87ae-80a603653269/a04449fa-f628-5149-87ae-80a603653269_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 145776,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b9aaeec9-105e-4441-a7c5-765a5765a11a_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a04449fa-f628-5149-87ae-80a603653269/a04449fa-f628-5149-87ae-80a603653269_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 274599,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b9aaeec9-105e-4441-a7c5-765a5765a11a_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a04449fa-f628-5149-87ae-80a603653269/a04449fa-f628-5149-87ae-80a603653269_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 347696,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3684908-3984090-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a04449fa-f628-5149-87ae-80a603653269/a04449fa-f628-5149-87ae-80a603653269_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 276467,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3684908-3984090-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a04449fa-f628-5149-87ae-80a603653269/a04449fa-f628-5149-87ae-80a603653269_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 406948,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3684908-3984090-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a04449fa-f628-5149-87ae-80a603653269/a04449fa-f628-5149-87ae-80a603653269_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 306926,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3684908-3984090-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a04449fa-f628-5149-87ae-80a603653269/a04449fa-f628-5149-87ae-80a603653269_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 367573,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3684908-3984090-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a04449fa-f628-5149-87ae-80a603653269/a04449fa-f628-5149-87ae-80a603653269_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 210715,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3684908-3984090-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a04449fa-f628-5149-87ae-80a603653269/a04449fa-f628-5149-87ae-80a603653269_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 309218,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3684908-3984090-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-10-31',
 'seller_name': 'Leasys',
 'title': 'CITROEN C3 1.2 PureTech 110 C-Series Edition 5dr EAT6',
 'transmission': 'automatic',
 'trim': '1.2 PureTech 110 C-Series Edition 5dr EAT6',
 'year': 2023}
2025-12-04 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273684908%27 HTTP/1.1" 200 None
2025-12-04 10:03:12 [manheim.gb] INFO: Saving data for 3684908: {'created_time': 1764842592.071152, 'last_price_update_time': 1764842592.071162, 'auction_closing_time': 1765270800.0}
2025-12-04 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3684908') HTTP/1.1" 204 0
2025-12-04 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4e0f13bc-e8b8-41f6-aeda-db604f626472_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4e0f13bc-e8b8-41f6-aeda-db604f626472_ext_5.jpg not downloaded yet
2025-12-04 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7771ef22-bf10-41ca-8823-6cd0d55ba8c1_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_ext_2.jpg not downloaded yet
2025-12-04 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Facb2ad77-4d07-4c83-8597-4ef78a2468db_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/acb2ad77-4d07-4c83-8597-4ef78a2468db_ext_7.jpg not downloaded yet
2025-12-04 10:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/KIA/SORENTO?id=3752430&returnUrl=%2Fsearch%3FPage%3D4%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233752430&indx=371> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4e0f13bc-e8b8-41f6-aeda-db604f626472_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4e0f13bc-e8b8-41f6-aeda-db604f626472_ext_3.jpg not downloaded yet
2025-12-04 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7771ef22-bf10-41ca-8823-6cd0d55ba8c1_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_ext_5.jpg not downloaded yet
2025-12-04 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Facb2ad77-4d07-4c83-8597-4ef78a2468db_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/acb2ad77-4d07-4c83-8597-4ef78a2468db_ext_6.jpg not downloaded yet
2025-12-04 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4e0f13bc-e8b8-41f6-aeda-db604f626472_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4e0f13bc-e8b8-41f6-aeda-db604f626472_ext_4.jpg not downloaded yet
2025-12-04 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7771ef22-bf10-41ca-8823-6cd0d55ba8c1_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_ext_3.jpg not downloaded yet
2025-12-04 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Facb2ad77-4d07-4c83-8597-4ef78a2468db_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/acb2ad77-4d07-4c83-8597-4ef78a2468db_ext_1.jpg not downloaded yet
2025-12-04 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3657400-4002829-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3657400-4002829-13.jpg not downloaded yet
2025-12-04 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7771ef22-bf10-41ca-8823-6cd0d55ba8c1_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_ext_4.jpg not downloaded yet
2025-12-04 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Facb2ad77-4d07-4c83-8597-4ef78a2468db_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/acb2ad77-4d07-4c83-8597-4ef78a2468db_5.jpg not downloaded yet
2025-12-04 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3657400-4002829-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3657400-4002829-1000.jpg not downloaded yet
2025-12-04 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3667925-4004533-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3667925-4004533-13.jpg not downloaded yet
2025-12-04 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Facb2ad77-4d07-4c83-8597-4ef78a2468db_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/acb2ad77-4d07-4c83-8597-4ef78a2468db_4.jpg not downloaded yet
2025-12-04 10:03:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2b11f28-5bb8-5cb7-b928-247e038a950d with identifier: 3752430
2025-12-04 10:03:12 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item f2b11f28-5bb8-5cb7-b928-247e038a950d
2025-12-04 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3657400-4002829-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3657400-4002829-1001.jpg not downloaded yet
2025-12-04 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3667925-4004533-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3667925-4004533-1000.jpg not downloaded yet
2025-12-04 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Facb2ad77-4d07-4c83-8597-4ef78a2468db_11.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/acb2ad77-4d07-4c83-8597-4ef78a2468db_11.jpg not downloaded yet
2025-12-04 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3657400-4002829-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3657400-4002829-1002.jpg not downloaded yet
2025-12-04 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3667925-4004533-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3667925-4004533-1001.jpg not downloaded yet
2025-12-04 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Facb2ad77-4d07-4c83-8597-4ef78a2468db_10.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/acb2ad77-4d07-4c83-8597-4ef78a2468db_10.jpg not downloaded yet
2025-12-04 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3657400-4002829-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3657400-4002829-1003.jpg not downloaded yet
2025-12-04 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3667925-4004533-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3667925-4004533-1002.jpg not downloaded yet
2025-12-04 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Facb2ad77-4d07-4c83-8597-4ef78a2468db_9.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/acb2ad77-4d07-4c83-8597-4ef78a2468db_9.jpg not downloaded yet
2025-12-04 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3657400-4002829-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3657400-4002829-1004.jpg not downloaded yet
2025-12-04 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3667925-4004533-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3667925-4004533-1003.jpg not downloaded yet
2025-12-04 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Facb2ad77-4d07-4c83-8597-4ef78a2468db_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/acb2ad77-4d07-4c83-8597-4ef78a2468db_ext_2.jpg not downloaded yet
2025-12-04 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3657400-4002829-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3657400-4002829-1005.jpg not downloaded yet
2025-12-04 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3667925-4004533-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3667925-4004533-1004.jpg not downloaded yet
2025-12-04 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Facb2ad77-4d07-4c83-8597-4ef78a2468db_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/acb2ad77-4d07-4c83-8597-4ef78a2468db_ext_5.jpg not downloaded yet
2025-12-04 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Facb2ad77-4d07-4c83-8597-4ef78a2468db_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/acb2ad77-4d07-4c83-8597-4ef78a2468db_ext_3.jpg not downloaded yet
2025-12-04 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Facb2ad77-4d07-4c83-8597-4ef78a2468db_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/acb2ad77-4d07-4c83-8597-4ef78a2468db_ext_4.jpg not downloaded yet
2025-12-04 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3637795-4005894-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3637795-4005894-13.jpg not downloaded yet
2025-12-04 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3637795-4005894-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3637795-4005894-1000.jpg not downloaded yet
2025-12-04 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3637795-4005894-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3637795-4005894-1001.jpg not downloaded yet
2025-12-04 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3637795-4005894-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3637795-4005894-1002.jpg not downloaded yet
2025-12-04 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3637795-4005894-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3637795-4005894-1003.jpg not downloaded yet
2025-12-04 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3637795-4005894-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3637795-4005894-1004.jpg not downloaded yet
2025-12-04 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3637795-4005894-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3637795-4005894-1005.jpg not downloaded yet
2025-12-04 10:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003616829-01593322-003.pdf> (referer: None)
2025-12-04 10:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3667925-4004533-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003667925-01980019-004.pdf)
2025-12-04 10:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3667925-4004533-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003667925-01980019-004.pdf)
2025-12-04 10:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3657400-4002829-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003657400-01990798-001.pdf)
2025-12-04 10:03:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce27cd0>
2025-12-04 10:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_515a4fc5-e945-522b-ac0a-4ba5a46d480f/515a4fc5-e945-522b-ac0a-4ba5a46d480f_expert_report_file_b6e5117c-e7e6-48f9-a2c3-4f630ec881bc.pdf HTTP/1.1" 201 0
2025-12-04 10:03:13 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 515a4fc5-e945-522b-ac0a-4ba5a46d480f
2025-12-04 10:03:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 515a4fc5-e945-522b-ac0a-4ba5a46d480f, skipping ID generation
2025-12-04 10:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 515a4fc5-e945-522b-ac0a-4ba5a46d480f
2025-12-04 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcf271a11-2493-483d-a329-c265658fc832_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cf271a11-2493-483d-a329-c265658fc832_ext_7.jpg already downloaded
2025-12-04 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcf271a11-2493-483d-a329-c265658fc832_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cf271a11-2493-483d-a329-c265658fc832_ext_7.jpg already downloaded
2025-12-04 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcf271a11-2493-483d-a329-c265658fc832_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cf271a11-2493-483d-a329-c265658fc832_ext_6.jpg already downloaded
2025-12-04 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcf271a11-2493-483d-a329-c265658fc832_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cf271a11-2493-483d-a329-c265658fc832_ext_1.jpg already downloaded
2025-12-04 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcf271a11-2493-483d-a329-c265658fc832_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cf271a11-2493-483d-a329-c265658fc832_5.jpg already downloaded
2025-12-04 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcf271a11-2493-483d-a329-c265658fc832_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cf271a11-2493-483d-a329-c265658fc832_4.jpg already downloaded
2025-12-04 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcf271a11-2493-483d-a329-c265658fc832_11.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cf271a11-2493-483d-a329-c265658fc832_11.jpg already downloaded
2025-12-04 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcf271a11-2493-483d-a329-c265658fc832_10.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cf271a11-2493-483d-a329-c265658fc832_10.jpg already downloaded
2025-12-04 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcf271a11-2493-483d-a329-c265658fc832_9.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cf271a11-2493-483d-a329-c265658fc832_9.jpg already downloaded
2025-12-04 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcf271a11-2493-483d-a329-c265658fc832_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cf271a11-2493-483d-a329-c265658fc832_ext_2.jpg already downloaded
2025-12-04 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcf271a11-2493-483d-a329-c265658fc832_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cf271a11-2493-483d-a329-c265658fc832_ext_5.jpg already downloaded
2025-12-04 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcf271a11-2493-483d-a329-c265658fc832_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cf271a11-2493-483d-a329-c265658fc832_ext_3.jpg already downloaded
2025-12-04 10:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcf271a11-2493-483d-a329-c265658fc832_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cf271a11-2493-483d-a329-c265658fc832_ext_4.jpg already downloaded
2025-12-04 10:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3616829-3961375-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3616829-3961375-13.jpg already downloaded
2025-12-04 10:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3616829-3961375-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3616829-3961375-1000.jpg already downloaded
2025-12-04 10:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3616829-3961375-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3616829-3961375-1001.jpg already downloaded
2025-12-04 10:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3616829-3961375-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3616829-3961375-1002.jpg already downloaded
2025-12-04 10:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3616829-3961375-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3616829-3961375-1003.jpg already downloaded
2025-12-04 10:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3616829-3961375-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3616829-3961375-1004.jpg already downloaded
2025-12-04 10:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3616829-3961375-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3616829-3961375-1005.jpg already downloaded
2025-12-04 10:03:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 515a4fc5-e945-522b-ac0a-4ba5a46d480f, identifier: 3616829
2025-12-04 10:03:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 515a4fc5-e945-522b-ac0a-4ba5a46d480f with identifier: 3616829
2025-12-04 10:03:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 515a4fc5-e945-522b-ac0a-4ba5a46d480f with identifier: 3616829
2025-12-04 10:03:14 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 150328 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    150328
2025-12-04 10:03:14 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 515a4fc5-e945-522b-ac0a-4ba5a46d480f spider: manheim.gb
2025-12-04 10:03:14 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 515a4fc5-e945-522b-ac0a-4ba5a46d480f due to rule: high_mileage_for_country.json, error: 150328 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    150328
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_515a4fc5-e945-522b-ac0a-4ba5a46d480f/515a4fc5-e945-522b-ac0a-4ba5a46d480f_expert_report_file_b6e5117c-e7e6-48f9-a2c3-4f630ec881bc.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003616829-01593322-003.pdf',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '3.0L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '515a4fc5-e945-522b-ac0a-4ba5a46d480f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'R17LDN',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/S%20CLASS?id=3616829',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'MERCEDES-BENZ',
 'model': 'S CLASS',
 'odometer': 93410,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 37,
 'photo_urls': ['http://images.manheim.co.uk/images/units/zoom/cf271a11-2493-483d-a329-c265658fc832_ext_7.jpg',
                'http://images.manheim.co.uk/images/units/zoom/cf271a11-2493-483d-a329-c265658fc832_ext_7.jpg',
                'http://images.manheim.co.uk/images/units/zoom/cf271a11-2493-483d-a329-c265658fc832_ext_6.jpg',
                'http://images.manheim.co.uk/images/units/zoom/cf271a11-2493-483d-a329-c265658fc832_ext_1.jpg',
                'http://images.manheim.co.uk/images/units/zoom/cf271a11-2493-483d-a329-c265658fc832_5.jpg',
                'http://images.manheim.co.uk/images/units/zoom/cf271a11-2493-483d-a329-c265658fc832_4.jpg',
                'http://images.manheim.co.uk/images/units/zoom/cf271a11-2493-483d-a329-c265658fc832_11.jpg',
                'http://images.manheim.co.uk/images/units/zoom/cf271a11-2493-483d-a329-c265658fc832_10.jpg',
                'http://images.manheim.co.uk/images/units/zoom/cf271a11-2493-483d-a329-c265658fc832_9.jpg',
                'http://images.manheim.co.uk/images/units/zoom/cf271a11-2493-483d-a329-c265658fc832_ext_2.jpg',
                'http://images.manheim.co.uk/images/units/zoom/cf271a11-2493-483d-a329-c265658fc832_ext_5.jpg',
                'http://images.manheim.co.uk/images/units/zoom/cf271a11-2493-483d-a329-c265658fc832_ext_3.jpg',
                'http://images.manheim.co.uk/images/units/zoom/cf271a11-2493-483d-a329-c265658fc832_ext_4.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3616829-3961375-13.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3616829-3961375-1000.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3616829-3961375-1001.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3616829-3961375-1002.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3616829-3961375-1003.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3616829-3961375-1004.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3616829-3961375-1005.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_515a4fc5-e945-522b-ac0a-4ba5a46d480f/515a4fc5-e945-522b-ac0a-4ba5a46d480f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 184317,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cf271a11-2493-483d-a329-c265658fc832_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_515a4fc5-e945-522b-ac0a-4ba5a46d480f/515a4fc5-e945-522b-ac0a-4ba5a46d480f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 184317,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cf271a11-2493-483d-a329-c265658fc832_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_515a4fc5-e945-522b-ac0a-4ba5a46d480f/515a4fc5-e945-522b-ac0a-4ba5a46d480f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 237754,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cf271a11-2493-483d-a329-c265658fc832_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_515a4fc5-e945-522b-ac0a-4ba5a46d480f/515a4fc5-e945-522b-ac0a-4ba5a46d480f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 220055,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cf271a11-2493-483d-a329-c265658fc832_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_515a4fc5-e945-522b-ac0a-4ba5a46d480f/515a4fc5-e945-522b-ac0a-4ba5a46d480f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 184631,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cf271a11-2493-483d-a329-c265658fc832_5.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_515a4fc5-e945-522b-ac0a-4ba5a46d480f/515a4fc5-e945-522b-ac0a-4ba5a46d480f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 181774,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cf271a11-2493-483d-a329-c265658fc832_4.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_515a4fc5-e945-522b-ac0a-4ba5a46d480f/515a4fc5-e945-522b-ac0a-4ba5a46d480f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 181178,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cf271a11-2493-483d-a329-c265658fc832_11.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_515a4fc5-e945-522b-ac0a-4ba5a46d480f/515a4fc5-e945-522b-ac0a-4ba5a46d480f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 180054,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cf271a11-2493-483d-a329-c265658fc832_10.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_515a4fc5-e945-522b-ac0a-4ba5a46d480f/515a4fc5-e945-522b-ac0a-4ba5a46d480f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 184090,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cf271a11-2493-483d-a329-c265658fc832_9.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_515a4fc5-e945-522b-ac0a-4ba5a46d480f/515a4fc5-e945-522b-ac0a-4ba5a46d480f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 263188,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cf271a11-2493-483d-a329-c265658fc832_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_515a4fc5-e945-522b-ac0a-4ba5a46d480f/515a4fc5-e945-522b-ac0a-4ba5a46d480f_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 232154,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cf271a11-2493-483d-a329-c265658fc832_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_515a4fc5-e945-522b-ac0a-4ba5a46d480f/515a4fc5-e945-522b-ac0a-4ba5a46d480f_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 216797,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cf271a11-2493-483d-a329-c265658fc832_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_515a4fc5-e945-522b-ac0a-4ba5a46d480f/515a4fc5-e945-522b-ac0a-4ba5a46d480f_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 305663,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cf271a11-2493-483d-a329-c265658fc832_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_515a4fc5-e945-522b-ac0a-4ba5a46d480f/515a4fc5-e945-522b-ac0a-4ba5a46d480f_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 348041,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3616829-3961375-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_515a4fc5-e945-522b-ac0a-4ba5a46d480f/515a4fc5-e945-522b-ac0a-4ba5a46d480f_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 316524,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3616829-3961375-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_515a4fc5-e945-522b-ac0a-4ba5a46d480f/515a4fc5-e945-522b-ac0a-4ba5a46d480f_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 418346,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3616829-3961375-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_515a4fc5-e945-522b-ac0a-4ba5a46d480f/515a4fc5-e945-522b-ac0a-4ba5a46d480f_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 323896,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3616829-3961375-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_515a4fc5-e945-522b-ac0a-4ba5a46d480f/515a4fc5-e945-522b-ac0a-4ba5a46d480f_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 356503,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3616829-3961375-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_515a4fc5-e945-522b-ac0a-4ba5a46d480f/515a4fc5-e945-522b-ac0a-4ba5a46d480f_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 367945,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3616829-3961375-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_515a4fc5-e945-522b-ac0a-4ba5a46d480f/515a4fc5-e945-522b-ac0a-4ba5a46d480f_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 291366,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3616829-3961375-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-18',
 'seller_name': 'MotoNovo Finance',
 'title': 'MERCEDES-BENZ S CLASS S350L BlueTEC AMG Line 4dr Auto',
 'transmission': 'automatic',
 'trim': 'S350L BlueTEC AMG Line 4dr Auto',
 'year': 2014}
2025-12-04 10:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273616829%27 HTTP/1.1" 200 None
2025-12-04 10:03:14 [manheim.gb] INFO: Saving data for 3616829: {'created_time': 1764842594.546525, 'last_price_update_time': 1764842594.546536, 'auction_closing_time': 1765270800.0}
2025-12-04 10:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3616829') HTTP/1.1" 204 0
2025-12-04 10:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/acb2ad77-4d07-4c83-8597-4ef78a2468db_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003637795-01992770-001.pdf)
2025-12-04 10:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/acb2ad77-4d07-4c83-8597-4ef78a2468db_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003637795-01992770-001.pdf)
2025-12-04 10:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3657400-4002829-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003657400-01990798-001.pdf)
2025-12-04 10:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/acb2ad77-4d07-4c83-8597-4ef78a2468db_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003637795-01992770-001.pdf)
2025-12-04 10:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/acb2ad77-4d07-4c83-8597-4ef78a2468db_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003637795-01992770-001.pdf)
2025-12-04 10:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/acb2ad77-4d07-4c83-8597-4ef78a2468db_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003637795-01992770-001.pdf)
2025-12-04 10:03:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccfac410>
2025-12-04 10:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_17.jpg HTTP/1.1" 201 0
2025-12-04 10:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3667925-4004533-1003.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3667925-4004533-1003.jpg saved to cache
2025-12-04 10:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 742a8c72-329e-5c3e-ab70-9041f08bc2a7
2025-12-04 10:03:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf31fd0>
2025-12-04 10:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_18.jpg HTTP/1.1" 201 0
2025-12-04 10:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3667925-4004533-1004.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3667925-4004533-1004.jpg saved to cache
2025-12-04 10:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 742a8c72-329e-5c3e-ab70-9041f08bc2a7
2025-12-04 10:03:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5a9dd0>
2025-12-04 10:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5788230a-dad4-5181-a72c-7c5ccf52b954/5788230a-dad4-5181-a72c-7c5ccf52b954_image_18.jpg HTTP/1.1" 201 0
2025-12-04 10:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3657400-4002829-1004.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3657400-4002829-1004.jpg saved to cache
2025-12-04 10:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 5788230a-dad4-5181-a72c-7c5ccf52b954
2025-12-04 10:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3657400-4002829-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003657400-01990798-001.pdf)
2025-12-04 10:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3667925-4004533-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003667925-01980019-004.pdf)
2025-12-04 10:03:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccfc0ad0>
2025-12-04 10:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf07de31-bff8-5f3c-b42a-e026fbf80708/cf07de31-bff8-5f3c-b42a-e026fbf80708_image_10.jpg HTTP/1.1" 201 0
2025-12-04 10:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Facb2ad77-4d07-4c83-8597-4ef78a2468db_ext_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/acb2ad77-4d07-4c83-8597-4ef78a2468db_ext_5.jpg saved to cache
2025-12-04 10:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item cf07de31-bff8-5f3c-b42a-e026fbf80708
2025-12-04 10:03:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc7f3e50>
2025-12-04 10:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 10:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf07de31-bff8-5f3c-b42a-e026fbf80708/cf07de31-bff8-5f3c-b42a-e026fbf80708_image_7.jpg HTTP/1.1" 201 0
2025-12-04 10:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Facb2ad77-4d07-4c83-8597-4ef78a2468db_10.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/acb2ad77-4d07-4c83-8597-4ef78a2468db_10.jpg saved to cache
2025-12-04 10:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cf07de31-bff8-5f3c-b42a-e026fbf80708
2025-12-04 10:03:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccfc2f90>
2025-12-04 10:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5788230a-dad4-5181-a72c-7c5ccf52b954/5788230a-dad4-5181-a72c-7c5ccf52b954_image_19.jpg HTTP/1.1" 201 0
2025-12-04 10:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3657400-4002829-1005.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3657400-4002829-1005.jpg saved to cache
2025-12-04 10:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 5788230a-dad4-5181-a72c-7c5ccf52b954
2025-12-04 10:03:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cccc7cd0>
2025-12-04 10:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf07de31-bff8-5f3c-b42a-e026fbf80708/cf07de31-bff8-5f3c-b42a-e026fbf80708_image_11.jpg HTTP/1.1" 201 0
2025-12-04 10:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Facb2ad77-4d07-4c83-8597-4ef78a2468db_ext_3.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/acb2ad77-4d07-4c83-8597-4ef78a2468db_ext_3.jpg saved to cache
2025-12-04 10:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item cf07de31-bff8-5f3c-b42a-e026fbf80708
2025-12-04 10:03:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc7f25d0>
2025-12-04 10:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf07de31-bff8-5f3c-b42a-e026fbf80708/cf07de31-bff8-5f3c-b42a-e026fbf80708_image_9.jpg HTTP/1.1" 201 0
2025-12-04 10:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Facb2ad77-4d07-4c83-8597-4ef78a2468db_ext_2.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/acb2ad77-4d07-4c83-8597-4ef78a2468db_ext_2.jpg saved to cache
2025-12-04 10:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cf07de31-bff8-5f3c-b42a-e026fbf80708
2025-12-04 10:03:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cccb9110>
2025-12-04 10:03:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf07de31-bff8-5f3c-b42a-e026fbf80708/cf07de31-bff8-5f3c-b42a-e026fbf80708_image_8.jpg HTTP/1.1" 201 0
2025-12-04 10:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Facb2ad77-4d07-4c83-8597-4ef78a2468db_9.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/acb2ad77-4d07-4c83-8597-4ef78a2468db_9.jpg saved to cache
2025-12-04 10:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cf07de31-bff8-5f3c-b42a-e026fbf80708
2025-12-04 10:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3657400-4002829-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003657400-01990798-001.pdf)
2025-12-04 10:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3667925-4004533-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003667925-01980019-004.pdf)
2025-12-04 10:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/acb2ad77-4d07-4c83-8597-4ef78a2468db_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003637795-01992770-001.pdf)
2025-12-04 10:03:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccfcd750>
2025-12-04 10:03:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5788230a-dad4-5181-a72c-7c5ccf52b954/5788230a-dad4-5181-a72c-7c5ccf52b954_image_17.jpg HTTP/1.1" 201 0
2025-12-04 10:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3657400-4002829-1003.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3657400-4002829-1003.jpg saved to cache
2025-12-04 10:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 5788230a-dad4-5181-a72c-7c5ccf52b954
2025-12-04 10:03:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5bf910>
2025-12-04 10:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_16.jpg HTTP/1.1" 201 0
2025-12-04 10:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3667925-4004533-1002.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3667925-4004533-1002.jpg saved to cache
2025-12-04 10:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 742a8c72-329e-5c3e-ab70-9041f08bc2a7
2025-12-04 10:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3637795-4005894-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003637795-01992770-001.pdf)
2025-12-04 10:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3637795-4005894-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003637795-01992770-001.pdf)
2025-12-04 10:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3637795-4005894-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003637795-01992770-001.pdf)
2025-12-04 10:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3637795-4005894-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003637795-01992770-001.pdf)
2025-12-04 10:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3637795-4005894-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003637795-01992770-001.pdf)
2025-12-04 10:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=3682181&returnUrl=%2Fsearch%3FPage%3D4%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233682181&indx=335> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 10:03:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6d2e50>
2025-12-04 10:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5788230a-dad4-5181-a72c-7c5ccf52b954/5788230a-dad4-5181-a72c-7c5ccf52b954_image_16.jpg HTTP/1.1" 201 0
2025-12-04 10:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3657400-4002829-1002.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3657400-4002829-1002.jpg saved to cache
2025-12-04 10:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 5788230a-dad4-5181-a72c-7c5ccf52b954
2025-12-04 10:03:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5bfad0>
2025-12-04 10:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 10:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_15.jpg HTTP/1.1" 201 0
2025-12-04 10:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3667925-4004533-1001.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3667925-4004533-1001.jpg saved to cache
2025-12-04 10:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 742a8c72-329e-5c3e-ab70-9041f08bc2a7
2025-12-04 10:03:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd044450>
2025-12-04 10:03:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf07de31-bff8-5f3c-b42a-e026fbf80708/cf07de31-bff8-5f3c-b42a-e026fbf80708_image_6.jpg HTTP/1.1" 201 0
2025-12-04 10:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Facb2ad77-4d07-4c83-8597-4ef78a2468db_11.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/acb2ad77-4d07-4c83-8597-4ef78a2468db_11.jpg saved to cache
2025-12-04 10:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cf07de31-bff8-5f3c-b42a-e026fbf80708
2025-12-04 10:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/acb2ad77-4d07-4c83-8597-4ef78a2468db_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003637795-01992770-001.pdf)
2025-12-04 10:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3637795-4005894-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003637795-01992770-001.pdf)
2025-12-04 10:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3667925-4004533-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003667925-01980019-004.pdf)
2025-12-04 10:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3657400-4002829-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003657400-01990798-001.pdf)
2025-12-04 10:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/acb2ad77-4d07-4c83-8597-4ef78a2468db_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003637795-01992770-001.pdf)
2025-12-04 10:03:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc7196d0>
2025-12-04 10:03:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf07de31-bff8-5f3c-b42a-e026fbf80708/cf07de31-bff8-5f3c-b42a-e026fbf80708_image_17.jpg HTTP/1.1" 201 0
2025-12-04 10:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3637795-4005894-1003.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3637795-4005894-1003.jpg saved to cache
2025-12-04 10:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item cf07de31-bff8-5f3c-b42a-e026fbf80708
2025-12-04 10:03:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd8a310>
2025-12-04 10:03:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf07de31-bff8-5f3c-b42a-e026fbf80708/cf07de31-bff8-5f3c-b42a-e026fbf80708_image_19.jpg HTTP/1.1" 201 0
2025-12-04 10:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3637795-4005894-1005.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3637795-4005894-1005.jpg saved to cache
2025-12-04 10:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item cf07de31-bff8-5f3c-b42a-e026fbf80708
2025-12-04 10:03:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cccabbd0>
2025-12-04 10:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf07de31-bff8-5f3c-b42a-e026fbf80708/cf07de31-bff8-5f3c-b42a-e026fbf80708_image_18.jpg HTTP/1.1" 201 0
2025-12-04 10:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3637795-4005894-1004.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3637795-4005894-1004.jpg saved to cache
2025-12-04 10:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item cf07de31-bff8-5f3c-b42a-e026fbf80708
2025-12-04 10:03:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccec5190>
2025-12-04 10:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf07de31-bff8-5f3c-b42a-e026fbf80708/cf07de31-bff8-5f3c-b42a-e026fbf80708_image_15.jpg HTTP/1.1" 201 0
2025-12-04 10:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3637795-4005894-1001.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3637795-4005894-1001.jpg saved to cache
2025-12-04 10:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item cf07de31-bff8-5f3c-b42a-e026fbf80708
2025-12-04 10:03:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf74f90>
2025-12-04 10:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf07de31-bff8-5f3c-b42a-e026fbf80708/cf07de31-bff8-5f3c-b42a-e026fbf80708_image_16.jpg HTTP/1.1" 201 0
2025-12-04 10:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3637795-4005894-1002.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3637795-4005894-1002.jpg saved to cache
2025-12-04 10:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item cf07de31-bff8-5f3c-b42a-e026fbf80708
2025-12-04 10:03:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9bd84f78-b040-546f-bd31-1f239321937f with identifier: 3682181
2025-12-04 10:03:21 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 9bd84f78-b040-546f-bd31-1f239321937f
2025-12-04 10:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3637795-4005894-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003637795-01992770-001.pdf)
2025-12-04 10:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3667925-4004533-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003667925-01980019-004.pdf)
2025-12-04 10:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3657400-4002829-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003657400-01990798-001.pdf)
2025-12-04 10:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/acb2ad77-4d07-4c83-8597-4ef78a2468db_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003637795-01992770-001.pdf)
2025-12-04 10:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003667925-01980019-004.pdf)
2025-12-04 10:03:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5ace50>
2025-12-04 10:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf07de31-bff8-5f3c-b42a-e026fbf80708/cf07de31-bff8-5f3c-b42a-e026fbf80708_image_12.jpg HTTP/1.1" 201 0
2025-12-04 10:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Facb2ad77-4d07-4c83-8597-4ef78a2468db_ext_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/acb2ad77-4d07-4c83-8597-4ef78a2468db_ext_4.jpg saved to cache
2025-12-04 10:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item cf07de31-bff8-5f3c-b42a-e026fbf80708
2025-12-04 10:03:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce9f8d0>
2025-12-04 10:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf07de31-bff8-5f3c-b42a-e026fbf80708/cf07de31-bff8-5f3c-b42a-e026fbf80708_image_13.jpg HTTP/1.1" 201 0
2025-12-04 10:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3637795-4005894-13.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3637795-4005894-13.jpg saved to cache
2025-12-04 10:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item cf07de31-bff8-5f3c-b42a-e026fbf80708
2025-12-04 10:03:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5bce50>
2025-12-04 10:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_14.jpg HTTP/1.1" 201 0
2025-12-04 10:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3667925-4004533-1000.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3667925-4004533-1000.jpg saved to cache
2025-12-04 10:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 742a8c72-329e-5c3e-ab70-9041f08bc2a7
2025-12-04 10:03:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce9f550>
2025-12-04 10:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5788230a-dad4-5181-a72c-7c5ccf52b954/5788230a-dad4-5181-a72c-7c5ccf52b954_image_14.jpg HTTP/1.1" 201 0
2025-12-04 10:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3657400-4002829-1000.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3657400-4002829-1000.jpg saved to cache
2025-12-04 10:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 5788230a-dad4-5181-a72c-7c5ccf52b954
2025-12-04 10:03:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccdd07d0>
2025-12-04 10:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf07de31-bff8-5f3c-b42a-e026fbf80708/cf07de31-bff8-5f3c-b42a-e026fbf80708_image_5.jpg HTTP/1.1" 201 0
2025-12-04 10:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Facb2ad77-4d07-4c83-8597-4ef78a2468db_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/acb2ad77-4d07-4c83-8597-4ef78a2468db_4.jpg saved to cache
2025-12-04 10:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cf07de31-bff8-5f3c-b42a-e026fbf80708
2025-12-04 10:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/acb2ad77-4d07-4c83-8597-4ef78a2468db_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003637795-01992770-001.pdf)
2025-12-04 10:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/acb2ad77-4d07-4c83-8597-4ef78a2468db_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003637795-01992770-001.pdf)
2025-12-04 10:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003667925-01980019-004.pdf)
2025-12-04 10:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/acb2ad77-4d07-4c83-8597-4ef78a2468db_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003637795-01992770-001.pdf)
2025-12-04 10:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003667925-01980019-004.pdf)
2025-12-04 10:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4e0f13bc-e8b8-41f6-aeda-db604f626472_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003657400-01990798-001.pdf)
2025-12-04 10:03:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5ae450>
2025-12-04 10:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf07de31-bff8-5f3c-b42a-e026fbf80708/cf07de31-bff8-5f3c-b42a-e026fbf80708_image_14.jpg HTTP/1.1" 201 0
2025-12-04 10:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3637795-4005894-1000.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3637795-4005894-1000.jpg saved to cache
2025-12-04 10:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item cf07de31-bff8-5f3c-b42a-e026fbf80708
2025-12-04 10:03:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6ce210>
2025-12-04 10:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_13.jpg HTTP/1.1" 201 0
2025-12-04 10:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3667925-4004533-13.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3667925-4004533-13.jpg saved to cache
2025-12-04 10:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 742a8c72-329e-5c3e-ab70-9041f08bc2a7
2025-12-04 10:03:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cccbb110>
2025-12-04 10:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5788230a-dad4-5181-a72c-7c5ccf52b954/5788230a-dad4-5181-a72c-7c5ccf52b954_image_15.jpg HTTP/1.1" 201 0
2025-12-04 10:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3657400-4002829-1001.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3657400-4002829-1001.jpg saved to cache
2025-12-04 10:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 5788230a-dad4-5181-a72c-7c5ccf52b954
2025-12-04 10:03:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccedbd50>
2025-12-04 10:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf07de31-bff8-5f3c-b42a-e026fbf80708/cf07de31-bff8-5f3c-b42a-e026fbf80708_image_4.jpg HTTP/1.1" 201 0
2025-12-04 10:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Facb2ad77-4d07-4c83-8597-4ef78a2468db_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/acb2ad77-4d07-4c83-8597-4ef78a2468db_5.jpg saved to cache
2025-12-04 10:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cf07de31-bff8-5f3c-b42a-e026fbf80708
2025-12-04 10:03:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5bc950>
2025-12-04 10:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_12.jpg HTTP/1.1" 201 0
2025-12-04 10:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7771ef22-bf10-41ca-8823-6cd0d55ba8c1_ext_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_ext_4.jpg saved to cache
2025-12-04 10:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 742a8c72-329e-5c3e-ab70-9041f08bc2a7
2025-12-04 10:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4e0f13bc-e8b8-41f6-aeda-db604f626472_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003657400-01990798-001.pdf)
2025-12-04 10:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3657400-4002829-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003657400-01990798-001.pdf)
2025-12-04 10:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003752430-01968960-003.pdf> (referer: None)
2025-12-04 10:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4e0f13bc-e8b8-41f6-aeda-db604f626472_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003657400-01990798-001.pdf)
2025-12-04 10:03:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd2c850>
2025-12-04 10:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf07de31-bff8-5f3c-b42a-e026fbf80708/cf07de31-bff8-5f3c-b42a-e026fbf80708_image_2.jpg HTTP/1.1" 201 0
2025-12-04 10:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Facb2ad77-4d07-4c83-8597-4ef78a2468db_ext_6.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/acb2ad77-4d07-4c83-8597-4ef78a2468db_ext_6.jpg saved to cache
2025-12-04 10:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cf07de31-bff8-5f3c-b42a-e026fbf80708
2025-12-04 10:03:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc7defd0>
2025-12-04 10:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf07de31-bff8-5f3c-b42a-e026fbf80708/cf07de31-bff8-5f3c-b42a-e026fbf80708_image_1.jpg HTTP/1.1" 201 0
2025-12-04 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Facb2ad77-4d07-4c83-8597-4ef78a2468db_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/acb2ad77-4d07-4c83-8597-4ef78a2468db_ext_7.jpg saved to cache
2025-12-04 10:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cf07de31-bff8-5f3c-b42a-e026fbf80708
2025-12-04 10:03:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd8a710>
2025-12-04 10:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_11.jpg HTTP/1.1" 201 0
2025-12-04 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7771ef22-bf10-41ca-8823-6cd0d55ba8c1_ext_3.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_ext_3.jpg saved to cache
2025-12-04 10:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 742a8c72-329e-5c3e-ab70-9041f08bc2a7
2025-12-04 10:03:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd22b710>
2025-12-04 10:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf07de31-bff8-5f3c-b42a-e026fbf80708/cf07de31-bff8-5f3c-b42a-e026fbf80708_image_3.jpg HTTP/1.1" 201 0
2025-12-04 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Facb2ad77-4d07-4c83-8597-4ef78a2468db_ext_1.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/acb2ad77-4d07-4c83-8597-4ef78a2468db_ext_1.jpg saved to cache
2025-12-04 10:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cf07de31-bff8-5f3c-b42a-e026fbf80708
2025-12-04 10:03:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cccc4450>
2025-12-04 10:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_10.jpg HTTP/1.1" 201 0
2025-12-04 10:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7771ef22-bf10-41ca-8823-6cd0d55ba8c1_ext_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_ext_5.jpg saved to cache
2025-12-04 10:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 742a8c72-329e-5c3e-ab70-9041f08bc2a7
2025-12-04 10:03:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc7dd450>
2025-12-04 10:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5788230a-dad4-5181-a72c-7c5ccf52b954/5788230a-dad4-5181-a72c-7c5ccf52b954_image_11.jpg HTTP/1.1" 201 0
2025-12-04 10:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4e0f13bc-e8b8-41f6-aeda-db604f626472_ext_3.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4e0f13bc-e8b8-41f6-aeda-db604f626472_ext_3.jpg saved to cache
2025-12-04 10:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 5788230a-dad4-5181-a72c-7c5ccf52b954
2025-12-04 10:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003667925-01980019-004.pdf)
2025-12-04 10:03:26 [scrapy.extensions.logstats] INFO: Crawled 64 pages (at 26 pages/min), scraped 3 items (at 2 items/min)
2025-12-04 10:03:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccdeb4d0>
2025-12-04 10:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5788230a-dad4-5181-a72c-7c5ccf52b954/5788230a-dad4-5181-a72c-7c5ccf52b954_image_12.jpg HTTP/1.1" 201 0
2025-12-04 10:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4e0f13bc-e8b8-41f6-aeda-db604f626472_ext_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4e0f13bc-e8b8-41f6-aeda-db604f626472_ext_4.jpg saved to cache
2025-12-04 10:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 5788230a-dad4-5181-a72c-7c5ccf52b954
2025-12-04 10:03:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ce410490>
2025-12-04 10:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5788230a-dad4-5181-a72c-7c5ccf52b954/5788230a-dad4-5181-a72c-7c5ccf52b954_image_13.jpg HTTP/1.1" 201 0
2025-12-04 10:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3657400-4002829-13.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3657400-4002829-13.jpg saved to cache
2025-12-04 10:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 5788230a-dad4-5181-a72c-7c5ccf52b954
2025-12-04 10:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/acb2ad77-4d07-4c83-8597-4ef78a2468db_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003637795-01992770-001.pdf)
2025-12-04 10:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003667925-01980019-004.pdf)
2025-12-04 10:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003667925-01980019-004.pdf)
2025-12-04 10:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003667925-01980019-004.pdf)
2025-12-04 10:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4e0f13bc-e8b8-41f6-aeda-db604f626472_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003657400-01990798-001.pdf)
2025-12-04 10:03:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccfd1850>
2025-12-04 10:03:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2b11f28-5bb8-5cb7-b928-247e038a950d/f2b11f28-5bb8-5cb7-b928-247e038a950d_expert_report_file_e8dfda7e-09b0-4144-8283-037cc710d3fc.pdf HTTP/1.1" 201 0
2025-12-04 10:03:27 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item f2b11f28-5bb8-5cb7-b928-247e038a950d
2025-12-04 10:03:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f2b11f28-5bb8-5cb7-b928-247e038a950d, skipping ID generation
2025-12-04 10:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item f2b11f28-5bb8-5cb7-b928-247e038a950d
2025-12-04 10:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4556e87a-6495-41d1-94f1-a21ad1a0730e_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4556e87a-6495-41d1-94f1-a21ad1a0730e_ext_7.jpg already downloaded
2025-12-04 10:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4556e87a-6495-41d1-94f1-a21ad1a0730e_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4556e87a-6495-41d1-94f1-a21ad1a0730e_ext_7.jpg already downloaded
2025-12-04 10:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4556e87a-6495-41d1-94f1-a21ad1a0730e_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4556e87a-6495-41d1-94f1-a21ad1a0730e_ext_6.jpg already downloaded
2025-12-04 10:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4556e87a-6495-41d1-94f1-a21ad1a0730e_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4556e87a-6495-41d1-94f1-a21ad1a0730e_ext_1.jpg already downloaded
2025-12-04 10:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4556e87a-6495-41d1-94f1-a21ad1a0730e_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4556e87a-6495-41d1-94f1-a21ad1a0730e_5.jpg already downloaded
2025-12-04 10:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4556e87a-6495-41d1-94f1-a21ad1a0730e_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4556e87a-6495-41d1-94f1-a21ad1a0730e_4.jpg already downloaded
2025-12-04 10:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4556e87a-6495-41d1-94f1-a21ad1a0730e_11.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4556e87a-6495-41d1-94f1-a21ad1a0730e_11.jpg already downloaded
2025-12-04 10:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4556e87a-6495-41d1-94f1-a21ad1a0730e_10.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4556e87a-6495-41d1-94f1-a21ad1a0730e_10.jpg already downloaded
2025-12-04 10:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4556e87a-6495-41d1-94f1-a21ad1a0730e_9.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4556e87a-6495-41d1-94f1-a21ad1a0730e_9.jpg already downloaded
2025-12-04 10:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4556e87a-6495-41d1-94f1-a21ad1a0730e_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4556e87a-6495-41d1-94f1-a21ad1a0730e_ext_2.jpg already downloaded
2025-12-04 10:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4556e87a-6495-41d1-94f1-a21ad1a0730e_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4556e87a-6495-41d1-94f1-a21ad1a0730e_ext_5.jpg already downloaded
2025-12-04 10:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4556e87a-6495-41d1-94f1-a21ad1a0730e_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4556e87a-6495-41d1-94f1-a21ad1a0730e_ext_3.jpg already downloaded
2025-12-04 10:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4556e87a-6495-41d1-94f1-a21ad1a0730e_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4556e87a-6495-41d1-94f1-a21ad1a0730e_ext_4.jpg already downloaded
2025-12-04 10:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3752430-3979985-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3752430-3979985-13.jpg already downloaded
2025-12-04 10:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3752430-3979985-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3752430-3979985-1000.jpg already downloaded
2025-12-04 10:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3752430-3979985-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3752430-3979985-1001.jpg already downloaded
2025-12-04 10:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3752430-3979985-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3752430-3979985-1002.jpg already downloaded
2025-12-04 10:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3752430-3979985-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3752430-3979985-1003.jpg already downloaded
2025-12-04 10:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3752430-3979985-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3752430-3979985-1004.jpg already downloaded
2025-12-04 10:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3752430-3979985-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3752430-3979985-1005.jpg already downloaded
2025-12-04 10:03:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: f2b11f28-5bb8-5cb7-b928-247e038a950d, identifier: 3752430
2025-12-04 10:03:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccfe2cd0>
2025-12-04 10:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5788230a-dad4-5181-a72c-7c5ccf52b954/5788230a-dad4-5181-a72c-7c5ccf52b954_image_10.jpg HTTP/1.1" 201 0
2025-12-04 10:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4e0f13bc-e8b8-41f6-aeda-db604f626472_ext_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4e0f13bc-e8b8-41f6-aeda-db604f626472_ext_5.jpg saved to cache
2025-12-04 10:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 5788230a-dad4-5181-a72c-7c5ccf52b954
2025-12-04 10:03:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ce704bd0>
2025-12-04 10:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_9.jpg HTTP/1.1" 201 0
2025-12-04 10:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7771ef22-bf10-41ca-8823-6cd0d55ba8c1_ext_2.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_ext_2.jpg saved to cache
2025-12-04 10:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 742a8c72-329e-5c3e-ab70-9041f08bc2a7
2025-12-04 10:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4e0f13bc-e8b8-41f6-aeda-db604f626472_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003657400-01990798-001.pdf)
2025-12-04 10:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003667925-01980019-004.pdf)
2025-12-04 10:03:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: f2b11f28-5bb8-5cb7-b928-247e038a950d with identifier: 3752430
2025-12-04 10:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-04 10:03:29 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Petrol%2FHybrid HTTP/1.1" 200 None
2025-12-04 10:03:29 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-04 10:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-04 10:03:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: f2b11f28-5bb8-5cb7-b928-247e038a950d with identifier: 3752430
2025-12-04 10:03:29 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: f2b11f28-5bb8-5cb7-b928-247e038a950d with identifier: 3752430 to the API
2025-12-04 10:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 10:03:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 10:03:30 [scrapy.core.scraper] DEBUG: Scraped from <200 http://ecr.manheim.co.uk/pdf/MOL-0003752430-01968960-003.pdf>
{'auction_title': '',
 'c_o_2_emission_value': 158,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2b11f28-5bb8-5cb7-b928-247e038a950d/f2b11f28-5bb8-5cb7-b928-247e038a950d_expert_report_file_e8dfda7e-09b0-4144-8283-037cc710d3fc.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003752430-01968960-003.pdf',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Petrol/Hybrid',
 'id': 'f2b11f28-5bb8-5cb7-b928-247e038a950d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'MM22TXS',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/KIA/SORENTO?id=3752430',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'KIA',
 'model': 'SORENTO',
 'odometer': 25999,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 25,
 'photo_urls': ['http://images.manheim.co.uk/images/units/zoom/4556e87a-6495-41d1-94f1-a21ad1a0730e_ext_7.jpg',
                'http://images.manheim.co.uk/images/units/zoom/4556e87a-6495-41d1-94f1-a21ad1a0730e_ext_7.jpg',
                'http://images.manheim.co.uk/images/units/zoom/4556e87a-6495-41d1-94f1-a21ad1a0730e_ext_6.jpg',
                'http://images.manheim.co.uk/images/units/zoom/4556e87a-6495-41d1-94f1-a21ad1a0730e_ext_1.jpg',
                'http://images.manheim.co.uk/images/units/zoom/4556e87a-6495-41d1-94f1-a21ad1a0730e_5.jpg',
                'http://images.manheim.co.uk/images/units/zoom/4556e87a-6495-41d1-94f1-a21ad1a0730e_4.jpg',
                'http://images.manheim.co.uk/images/units/zoom/4556e87a-6495-41d1-94f1-a21ad1a0730e_11.jpg',
                'http://images.manheim.co.uk/images/units/zoom/4556e87a-6495-41d1-94f1-a21ad1a0730e_10.jpg',
                'http://images.manheim.co.uk/images/units/zoom/4556e87a-6495-41d1-94f1-a21ad1a0730e_9.jpg',
                'http://images.manheim.co.uk/images/units/zoom/4556e87a-6495-41d1-94f1-a21ad1a0730e_ext_2.jpg',
                'http://images.manheim.co.uk/images/units/zoom/4556e87a-6495-41d1-94f1-a21ad1a0730e_ext_5.jpg',
                'http://images.manheim.co.uk/images/units/zoom/4556e87a-6495-41d1-94f1-a21ad1a0730e_ext_3.jpg',
                'http://images.manheim.co.uk/images/units/zoom/4556e87a-6495-41d1-94f1-a21ad1a0730e_ext_4.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3752430-3979985-13.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3752430-3979985-1000.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3752430-3979985-1001.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3752430-3979985-1002.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3752430-3979985-1003.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3752430-3979985-1004.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3752430-3979985-1005.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2b11f28-5bb8-5cb7-b928-247e038a950d/f2b11f28-5bb8-5cb7-b928-247e038a950d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 182872,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4556e87a-6495-41d1-94f1-a21ad1a0730e_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2b11f28-5bb8-5cb7-b928-247e038a950d/f2b11f28-5bb8-5cb7-b928-247e038a950d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 182872,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4556e87a-6495-41d1-94f1-a21ad1a0730e_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2b11f28-5bb8-5cb7-b928-247e038a950d/f2b11f28-5bb8-5cb7-b928-247e038a950d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 321311,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4556e87a-6495-41d1-94f1-a21ad1a0730e_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2b11f28-5bb8-5cb7-b928-247e038a950d/f2b11f28-5bb8-5cb7-b928-247e038a950d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 164270,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4556e87a-6495-41d1-94f1-a21ad1a0730e_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2b11f28-5bb8-5cb7-b928-247e038a950d/f2b11f28-5bb8-5cb7-b928-247e038a950d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 180041,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4556e87a-6495-41d1-94f1-a21ad1a0730e_5.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2b11f28-5bb8-5cb7-b928-247e038a950d/f2b11f28-5bb8-5cb7-b928-247e038a950d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 175951,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4556e87a-6495-41d1-94f1-a21ad1a0730e_4.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2b11f28-5bb8-5cb7-b928-247e038a950d/f2b11f28-5bb8-5cb7-b928-247e038a950d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 183749,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4556e87a-6495-41d1-94f1-a21ad1a0730e_11.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2b11f28-5bb8-5cb7-b928-247e038a950d/f2b11f28-5bb8-5cb7-b928-247e038a950d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 178681,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4556e87a-6495-41d1-94f1-a21ad1a0730e_10.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2b11f28-5bb8-5cb7-b928-247e038a950d/f2b11f28-5bb8-5cb7-b928-247e038a950d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 182795,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4556e87a-6495-41d1-94f1-a21ad1a0730e_9.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2b11f28-5bb8-5cb7-b928-247e038a950d/f2b11f28-5bb8-5cb7-b928-247e038a950d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 302756,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4556e87a-6495-41d1-94f1-a21ad1a0730e_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2b11f28-5bb8-5cb7-b928-247e038a950d/f2b11f28-5bb8-5cb7-b928-247e038a950d_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 298920,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4556e87a-6495-41d1-94f1-a21ad1a0730e_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2b11f28-5bb8-5cb7-b928-247e038a950d/f2b11f28-5bb8-5cb7-b928-247e038a950d_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 280619,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4556e87a-6495-41d1-94f1-a21ad1a0730e_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2b11f28-5bb8-5cb7-b928-247e038a950d/f2b11f28-5bb8-5cb7-b928-247e038a950d_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 231279,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4556e87a-6495-41d1-94f1-a21ad1a0730e_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2b11f28-5bb8-5cb7-b928-247e038a950d/f2b11f28-5bb8-5cb7-b928-247e038a950d_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 405636,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3752430-3979985-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2b11f28-5bb8-5cb7-b928-247e038a950d/f2b11f28-5bb8-5cb7-b928-247e038a950d_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 257859,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3752430-3979985-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2b11f28-5bb8-5cb7-b928-247e038a950d/f2b11f28-5bb8-5cb7-b928-247e038a950d_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 264348,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3752430-3979985-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2b11f28-5bb8-5cb7-b928-247e038a950d/f2b11f28-5bb8-5cb7-b928-247e038a950d_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 359946,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3752430-3979985-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2b11f28-5bb8-5cb7-b928-247e038a950d/f2b11f28-5bb8-5cb7-b928-247e038a950d_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 396640,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3752430-3979985-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2b11f28-5bb8-5cb7-b928-247e038a950d/f2b11f28-5bb8-5cb7-b928-247e038a950d_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 313983,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3752430-3979985-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2b11f28-5bb8-5cb7-b928-247e038a950d/f2b11f28-5bb8-5cb7-b928-247e038a950d_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 342353,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3752430-3979985-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-04',
 'seller_name': 'Leasys',
 'title': 'KIA SORENTO 1.6 T-GDi HEV 2 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.6 T-GDi HEV 2 5dr Auto',
 'year': 2022}
2025-12-04 10:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273752430%27 HTTP/1.1" 200 None
2025-12-04 10:03:30 [manheim.gb] INFO: Saving data for 3752430: {'created_time': 1764842610.476436, 'last_price_update_time': 1764842610.476449, 'auction_closing_time': 1765270800.0}
2025-12-04 10:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3752430') HTTP/1.1" 204 0
2025-12-04 10:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4e0f13bc-e8b8-41f6-aeda-db604f626472_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003657400-01990798-001.pdf)
2025-12-04 10:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003667925-01980019-004.pdf)
2025-12-04 10:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4e0f13bc-e8b8-41f6-aeda-db604f626472_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003657400-01990798-001.pdf)
2025-12-04 10:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003667925-01980019-004.pdf)
2025-12-04 10:03:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd0a1490>
2025-12-04 10:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf07de31-bff8-5f3c-b42a-e026fbf80708/cf07de31-bff8-5f3c-b42a-e026fbf80708_image_0.jpg HTTP/1.1" 201 0
2025-12-04 10:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Facb2ad77-4d07-4c83-8597-4ef78a2468db_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/acb2ad77-4d07-4c83-8597-4ef78a2468db_ext_7.jpg saved to cache
2025-12-04 10:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cf07de31-bff8-5f3c-b42a-e026fbf80708
2025-12-04 10:03:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cf07de31-bff8-5f3c-b42a-e026fbf80708, skipping ID generation
2025-12-04 10:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Removing item cf07de31-bff8-5f3c-b42a-e026fbf80708 from tracking dictionaries
2025-12-04 10:03:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cf07de31-bff8-5f3c-b42a-e026fbf80708 sending to next pipeline
2025-12-04 10:03:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: cf07de31-bff8-5f3c-b42a-e026fbf80708, identifier: 3637795
2025-12-04 10:03:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd0a3950>
2025-12-04 10:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_6.jpg HTTP/1.1" 201 0
2025-12-04 10:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7771ef22-bf10-41ca-8823-6cd0d55ba8c1_11.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_11.jpg saved to cache
2025-12-04 10:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 742a8c72-329e-5c3e-ab70-9041f08bc2a7
2025-12-04 10:03:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6fcb50>
2025-12-04 10:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_8.jpg HTTP/1.1" 201 0
2025-12-04 10:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7771ef22-bf10-41ca-8823-6cd0d55ba8c1_9.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_9.jpg saved to cache
2025-12-04 10:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 742a8c72-329e-5c3e-ab70-9041f08bc2a7
2025-12-04 10:03:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce53190>
2025-12-04 10:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_7.jpg HTTP/1.1" 201 0
2025-12-04 10:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7771ef22-bf10-41ca-8823-6cd0d55ba8c1_10.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_10.jpg saved to cache
2025-12-04 10:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 742a8c72-329e-5c3e-ab70-9041f08bc2a7
2025-12-04 10:03:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd01eb90>
2025-12-04 10:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5788230a-dad4-5181-a72c-7c5ccf52b954/5788230a-dad4-5181-a72c-7c5ccf52b954_image_8.jpg HTTP/1.1" 201 0
2025-12-04 10:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4e0f13bc-e8b8-41f6-aeda-db604f626472_9.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4e0f13bc-e8b8-41f6-aeda-db604f626472_9.jpg saved to cache
2025-12-04 10:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5788230a-dad4-5181-a72c-7c5ccf52b954
2025-12-04 10:03:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6e4810>
2025-12-04 10:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5788230a-dad4-5181-a72c-7c5ccf52b954/5788230a-dad4-5181-a72c-7c5ccf52b954_image_9.jpg HTTP/1.1" 201 0
2025-12-04 10:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4e0f13bc-e8b8-41f6-aeda-db604f626472_ext_2.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4e0f13bc-e8b8-41f6-aeda-db604f626472_ext_2.jpg saved to cache
2025-12-04 10:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5788230a-dad4-5181-a72c-7c5ccf52b954
2025-12-04 10:03:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cced8a10>
2025-12-04 10:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_5.jpg HTTP/1.1" 201 0
2025-12-04 10:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7771ef22-bf10-41ca-8823-6cd0d55ba8c1_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_4.jpg saved to cache
2025-12-04 10:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 742a8c72-329e-5c3e-ab70-9041f08bc2a7
2025-12-04 10:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4e0f13bc-e8b8-41f6-aeda-db604f626472_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003657400-01990798-001.pdf)
2025-12-04 10:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4e0f13bc-e8b8-41f6-aeda-db604f626472_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003657400-01990798-001.pdf)
2025-12-04 10:03:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: cf07de31-bff8-5f3c-b42a-e026fbf80708 with identifier: 3637795
2025-12-04 10:03:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: cf07de31-bff8-5f3c-b42a-e026fbf80708 with identifier: 3637795
2025-12-04 10:03:33 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: cf07de31-bff8-5f3c-b42a-e026fbf80708 with identifier: 3637795 to the API
2025-12-04 10:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 10:03:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 10:03:33 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/acb2ad77-4d07-4c83-8597-4ef78a2468db_ext_7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 145,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf07de31-bff8-5f3c-b42a-e026fbf80708/cf07de31-bff8-5f3c-b42a-e026fbf80708_expert_report_file_28f8df50-61e4-4421-941e-4ee3852458da.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003637795-01992770-001.pdf',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '1.3L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'cf07de31-bff8-5f3c-b42a-e026fbf80708',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'YB70DHE',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=3637795',
 'listing': 'auction',
 'location': 'Leeds - In Transit',
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 59750,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 26,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf07de31-bff8-5f3c-b42a-e026fbf80708/cf07de31-bff8-5f3c-b42a-e026fbf80708_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 193570,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/acb2ad77-4d07-4c83-8597-4ef78a2468db_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf07de31-bff8-5f3c-b42a-e026fbf80708/cf07de31-bff8-5f3c-b42a-e026fbf80708_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 193570,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/acb2ad77-4d07-4c83-8597-4ef78a2468db_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf07de31-bff8-5f3c-b42a-e026fbf80708/cf07de31-bff8-5f3c-b42a-e026fbf80708_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 191861,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/acb2ad77-4d07-4c83-8597-4ef78a2468db_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf07de31-bff8-5f3c-b42a-e026fbf80708/cf07de31-bff8-5f3c-b42a-e026fbf80708_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 238241,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/acb2ad77-4d07-4c83-8597-4ef78a2468db_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf07de31-bff8-5f3c-b42a-e026fbf80708/cf07de31-bff8-5f3c-b42a-e026fbf80708_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 178560,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/acb2ad77-4d07-4c83-8597-4ef78a2468db_5.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf07de31-bff8-5f3c-b42a-e026fbf80708/cf07de31-bff8-5f3c-b42a-e026fbf80708_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 197159,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/acb2ad77-4d07-4c83-8597-4ef78a2468db_4.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf07de31-bff8-5f3c-b42a-e026fbf80708/cf07de31-bff8-5f3c-b42a-e026fbf80708_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 183598,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/acb2ad77-4d07-4c83-8597-4ef78a2468db_11.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf07de31-bff8-5f3c-b42a-e026fbf80708/cf07de31-bff8-5f3c-b42a-e026fbf80708_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 194762,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/acb2ad77-4d07-4c83-8597-4ef78a2468db_10.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf07de31-bff8-5f3c-b42a-e026fbf80708/cf07de31-bff8-5f3c-b42a-e026fbf80708_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 204767,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/acb2ad77-4d07-4c83-8597-4ef78a2468db_9.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf07de31-bff8-5f3c-b42a-e026fbf80708/cf07de31-bff8-5f3c-b42a-e026fbf80708_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 257888,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/acb2ad77-4d07-4c83-8597-4ef78a2468db_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf07de31-bff8-5f3c-b42a-e026fbf80708/cf07de31-bff8-5f3c-b42a-e026fbf80708_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 164056,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/acb2ad77-4d07-4c83-8597-4ef78a2468db_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf07de31-bff8-5f3c-b42a-e026fbf80708/cf07de31-bff8-5f3c-b42a-e026fbf80708_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 213075,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/acb2ad77-4d07-4c83-8597-4ef78a2468db_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf07de31-bff8-5f3c-b42a-e026fbf80708/cf07de31-bff8-5f3c-b42a-e026fbf80708_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 224490,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/acb2ad77-4d07-4c83-8597-4ef78a2468db_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf07de31-bff8-5f3c-b42a-e026fbf80708/cf07de31-bff8-5f3c-b42a-e026fbf80708_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 409743,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3637795-4005894-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf07de31-bff8-5f3c-b42a-e026fbf80708/cf07de31-bff8-5f3c-b42a-e026fbf80708_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 541377,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3637795-4005894-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf07de31-bff8-5f3c-b42a-e026fbf80708/cf07de31-bff8-5f3c-b42a-e026fbf80708_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 408661,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3637795-4005894-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf07de31-bff8-5f3c-b42a-e026fbf80708/cf07de31-bff8-5f3c-b42a-e026fbf80708_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 412197,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3637795-4005894-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf07de31-bff8-5f3c-b42a-e026fbf80708/cf07de31-bff8-5f3c-b42a-e026fbf80708_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 364817,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3637795-4005894-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf07de31-bff8-5f3c-b42a-e026fbf80708/cf07de31-bff8-5f3c-b42a-e026fbf80708_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 420631,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3637795-4005894-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf07de31-bff8-5f3c-b42a-e026fbf80708/cf07de31-bff8-5f3c-b42a-e026fbf80708_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 377722,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3637795-4005894-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-27',
 'seller_name': 'Mobilize Financial Services',
 'title': 'NISSAN QASHQAI 1.3 DiG-T N-Connecta 5dr [Glass Roof Pack]',
 'transmission': 'manual',
 'trim': '1.3 DiG-T N-Connecta 5dr [Glass Roof Pack]',
 'year': 2020}
2025-12-04 10:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273637795%27 HTTP/1.1" 200 None
2025-12-04 10:03:33 [manheim.gb] INFO: Saving data for 3637795: {'created_time': 1764842613.521785, 'last_price_update_time': 1764842613.521798, 'auction_closing_time': 1765184400.0}
2025-12-04 10:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3637795') HTTP/1.1" 204 0
2025-12-04 10:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003667925-01980019-004.pdf)
2025-12-04 10:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3060716-3999638-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003060716-01984777-003.pdf)
2025-12-04 10:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4e0f13bc-e8b8-41f6-aeda-db604f626472_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003657400-01990798-001.pdf)
2025-12-04 10:03:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc672310>
2025-12-04 10:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5788230a-dad4-5181-a72c-7c5ccf52b954/5788230a-dad4-5181-a72c-7c5ccf52b954_image_7.jpg HTTP/1.1" 201 0
2025-12-04 10:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4e0f13bc-e8b8-41f6-aeda-db604f626472_10.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4e0f13bc-e8b8-41f6-aeda-db604f626472_10.jpg saved to cache
2025-12-04 10:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5788230a-dad4-5181-a72c-7c5ccf52b954
2025-12-04 10:03:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd0c9c50>
2025-12-04 10:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_4.jpg HTTP/1.1" 201 0
2025-12-04 10:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7771ef22-bf10-41ca-8823-6cd0d55ba8c1_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_5.jpg saved to cache
2025-12-04 10:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 742a8c72-329e-5c3e-ab70-9041f08bc2a7
2025-12-04 10:03:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce11d10>
2025-12-04 10:03:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 10:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5788230a-dad4-5181-a72c-7c5ccf52b954/5788230a-dad4-5181-a72c-7c5ccf52b954_image_6.jpg HTTP/1.1" 201 0
2025-12-04 10:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4e0f13bc-e8b8-41f6-aeda-db604f626472_11.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4e0f13bc-e8b8-41f6-aeda-db604f626472_11.jpg saved to cache
2025-12-04 10:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5788230a-dad4-5181-a72c-7c5ccf52b954
2025-12-04 10:03:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd105050>
2025-12-04 10:03:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_3.jpg HTTP/1.1" 201 0
2025-12-04 10:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7771ef22-bf10-41ca-8823-6cd0d55ba8c1_ext_1.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_ext_1.jpg saved to cache
2025-12-04 10:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 742a8c72-329e-5c3e-ab70-9041f08bc2a7
2025-12-04 10:03:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce12c10>
2025-12-04 10:03:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5788230a-dad4-5181-a72c-7c5ccf52b954/5788230a-dad4-5181-a72c-7c5ccf52b954_image_4.jpg HTTP/1.1" 201 0
2025-12-04 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4e0f13bc-e8b8-41f6-aeda-db604f626472_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4e0f13bc-e8b8-41f6-aeda-db604f626472_5.jpg saved to cache
2025-12-04 10:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5788230a-dad4-5181-a72c-7c5ccf52b954
2025-12-04 10:03:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccc69190>
2025-12-04 10:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5788230a-dad4-5181-a72c-7c5ccf52b954/5788230a-dad4-5181-a72c-7c5ccf52b954_image_5.jpg HTTP/1.1" 201 0
2025-12-04 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4e0f13bc-e8b8-41f6-aeda-db604f626472_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4e0f13bc-e8b8-41f6-aeda-db604f626472_4.jpg saved to cache
2025-12-04 10:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5788230a-dad4-5181-a72c-7c5ccf52b954
2025-12-04 10:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4e0f13bc-e8b8-41f6-aeda-db604f626472_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003657400-01990798-001.pdf)
2025-12-04 10:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003667925-01980019-004.pdf)
2025-12-04 10:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3060716-3999638-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003060716-01984777-003.pdf)
2025-12-04 10:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4e0f13bc-e8b8-41f6-aeda-db604f626472_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003657400-01990798-001.pdf)
2025-12-04 10:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003667925-01980019-004.pdf)
2025-12-04 10:03:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc652d50>
2025-12-04 10:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_2.jpg HTTP/1.1" 201 0
2025-12-04 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7771ef22-bf10-41ca-8823-6cd0d55ba8c1_ext_6.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_ext_6.jpg saved to cache
2025-12-04 10:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 742a8c72-329e-5c3e-ab70-9041f08bc2a7
2025-12-04 10:03:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccffc710>
2025-12-04 10:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f42018c-b167-5adb-8c09-c35c5ecb3c4e/9f42018c-b167-5adb-8c09-c35c5ecb3c4e_image_19.jpg HTTP/1.1" 201 0
2025-12-04 10:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3060716-3999638-1005.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3060716-3999638-1005.jpg saved to cache
2025-12-04 10:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 9f42018c-b167-5adb-8c09-c35c5ecb3c4e
2025-12-04 10:03:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cccbb710>
2025-12-04 10:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5788230a-dad4-5181-a72c-7c5ccf52b954/5788230a-dad4-5181-a72c-7c5ccf52b954_image_3.jpg HTTP/1.1" 201 0
2025-12-04 10:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4e0f13bc-e8b8-41f6-aeda-db604f626472_ext_1.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4e0f13bc-e8b8-41f6-aeda-db604f626472_ext_1.jpg saved to cache
2025-12-04 10:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5788230a-dad4-5181-a72c-7c5ccf52b954
2025-12-04 10:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003682181-01988700-002.pdf> (referer: None)
2025-12-04 10:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003684907-01969138-004.pdf> (referer: None)
2025-12-04 10:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3060716-3999638-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003060716-01984777-003.pdf)
2025-12-04 10:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3060716-3999638-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003060716-01984777-003.pdf)
2025-12-04 10:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3060716-3999638-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003060716-01984777-003.pdf)
2025-12-04 10:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4e0f13bc-e8b8-41f6-aeda-db604f626472_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003657400-01990798-001.pdf)
2025-12-04 10:03:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccfbfe90>
2025-12-04 10:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5788230a-dad4-5181-a72c-7c5ccf52b954/5788230a-dad4-5181-a72c-7c5ccf52b954_image_2.jpg HTTP/1.1" 201 0
2025-12-04 10:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4e0f13bc-e8b8-41f6-aeda-db604f626472_ext_6.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4e0f13bc-e8b8-41f6-aeda-db604f626472_ext_6.jpg saved to cache
2025-12-04 10:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5788230a-dad4-5181-a72c-7c5ccf52b954
2025-12-04 10:03:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6c4990>
2025-12-04 10:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_1.jpg HTTP/1.1" 201 0
2025-12-04 10:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7771ef22-bf10-41ca-8823-6cd0d55ba8c1_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_ext_7.jpg saved to cache
2025-12-04 10:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 742a8c72-329e-5c3e-ab70-9041f08bc2a7
2025-12-04 10:03:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd004350>
2025-12-04 10:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f42018c-b167-5adb-8c09-c35c5ecb3c4e/9f42018c-b167-5adb-8c09-c35c5ecb3c4e_image_18.jpg HTTP/1.1" 201 0
2025-12-04 10:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3060716-3999638-1004.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3060716-3999638-1004.jpg saved to cache
2025-12-04 10:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 9f42018c-b167-5adb-8c09-c35c5ecb3c4e
2025-12-04 10:03:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf31a50>
2025-12-04 10:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5788230a-dad4-5181-a72c-7c5ccf52b954/5788230a-dad4-5181-a72c-7c5ccf52b954_image_1.jpg HTTP/1.1" 201 0
2025-12-04 10:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4e0f13bc-e8b8-41f6-aeda-db604f626472_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4e0f13bc-e8b8-41f6-aeda-db604f626472_ext_7.jpg saved to cache
2025-12-04 10:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5788230a-dad4-5181-a72c-7c5ccf52b954
2025-12-04 10:03:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd8a710>
2025-12-04 10:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_0.jpg HTTP/1.1" 201 0
2025-12-04 10:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7771ef22-bf10-41ca-8823-6cd0d55ba8c1_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_ext_7.jpg saved to cache
2025-12-04 10:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 742a8c72-329e-5c3e-ab70-9041f08bc2a7
2025-12-04 10:03:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 742a8c72-329e-5c3e-ab70-9041f08bc2a7, skipping ID generation
2025-12-04 10:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 742a8c72-329e-5c3e-ab70-9041f08bc2a7 from tracking dictionaries
2025-12-04 10:03:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 742a8c72-329e-5c3e-ab70-9041f08bc2a7 sending to next pipeline
2025-12-04 10:03:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 742a8c72-329e-5c3e-ab70-9041f08bc2a7, identifier: 3667925
2025-12-04 10:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3060716-3999638-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003060716-01984777-003.pdf)
2025-12-04 10:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3060716-3999638-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003060716-01984777-003.pdf)
2025-12-04 10:03:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 742a8c72-329e-5c3e-ab70-9041f08bc2a7 with identifier: 3667925
2025-12-04 10:03:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 742a8c72-329e-5c3e-ab70-9041f08bc2a7 with identifier: 3667925
2025-12-04 10:03:38 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 19, 'seller_name': 'novuna vehicle solutions', 'price_includes_vat': False, 'title': 'gwm ora 03 126kw pure+ 48kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'gwm ora', 'model': '03', 'transmission': 'automatic', 'engine': '0.0l', 'fuel_type': 'electric', 'odometer': 5322, 'odometer_reading_unit': 'mi', 'registration_date': '2024-03-14', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/gwm%20ora/03?id=3667925', 'location': 'bristol', 'origin_country_code': 'gb', 'trim': '126kw pure+ 48kwh 5dr auto', 'license_plate': 'bn24vke', 'year': 2024, 'listing': 'auction', 'c_o_2_emission_value': 0, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0003667925-01980019-004.pdf', 'expiration_date': '2025-12-09t09:00:00z', 'is_vat_deductible': True, 'is_vat_included': False, 'id': '742a8c72-329e-5c3e-ab70-9041f08bc2a7', 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_expert_report_file_f9ff82fc-1644-4bbf-b350-b4232efe3a02.pdf', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_0.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_ext_7.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 198602}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_1.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_ext_7.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 198602}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_2.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_ext_6.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 251203}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_3.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_ext_1.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 187010}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_4.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_5.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 206049}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_5.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_4.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 183993}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_6.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_11.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 182319}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_7.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_10.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 197787}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_8.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_9.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 216119}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_9.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_ext_2.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 283628}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_10.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_ext_5.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 224571}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_11.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_ext_3.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 249595}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_12.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_ext_4.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 178250}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_13.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3667925-4004533-13.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 316445}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_14.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3667925-4004533-1000.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 227558}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_15.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3667925-4004533-1001.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 372348}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_16.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3667925-4004533-1002.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 391448}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_17.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3667925-4004533-1003.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 302543}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_18.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3667925-4004533-1004.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 196908}], 'current_year_diff': 1, 'age_in_months': 20, 'make_model': 'gwm ora 03', 'sanitized_make': 'gwmora', 'odometer_in_km': 8564} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 20,
     'auction_title': '',
     'c_o_2_emission_value': 0,
     'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_expert_report_file_f9ff82fc-1644-4bbf-b350-b4232efe3a02.pdf',
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0003667925-01980019-004.pdf',
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 1,
     'engine': '0.0l',
     'expiration_date': '2025-12-09t09:00:00z',
     'fuel_type': 'electric',
     'id': '742a8c72-329e-5c3e-ab70-9041f08bc2a7',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'bn24vke',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/gwm%20ora/03?id=3667925',
     'listing': 'auction',
     'location': 'bristol',
     'make': 'gwm ora',
     'make_model': 'gwm ora 03',
     'model': '03',
     'odometer': 5322,
     'odometer_in_km': 8564,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 19,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 198602,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_ext_7.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 198602,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_ext_7.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 251203,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_ext_6.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 187010,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_ext_1.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 206049,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_5.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 183993,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_4.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 182319,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_11.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 197787,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_10.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 216119,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_9.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 283628,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_ext_2.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 224571,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_ext_5.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 249595,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_ext_3.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 178250,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_ext_4.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 316445,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3667925-4004533-13.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 227558,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3667925-4004533-1000.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_15.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 372348,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3667925-4004533-1001.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_16.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 391448,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3667925-4004533-1002.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_17.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 302543,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3667925-4004533-1003.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_18.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 196908,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3667925-4004533-1004.jpg',
                 'Width': 1333}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2024-03-14',
     'sanitized_make': 'gwmora',
     'seller_name': 'novuna vehicle solutions',
     'title': 'gwm ora 03 126kw pure+ 48kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '126kw pure+ 48kwh 5dr auto',
     'year': 2024}
2025-12-04 10:03:38 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 742a8c72-329e-5c3e-ab70-9041f08bc2a7 spider: manheim.gb
2025-12-04 10:03:38 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 742a8c72-329e-5c3e-ab70-9041f08bc2a7 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 19, 'seller_name': 'novuna vehicle solutions', 'price_includes_vat': False, 'title': 'gwm ora 03 126kw pure+ 48kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'gwm ora', 'model': '03', 'transmission': 'automatic', 'engine': '0.0l', 'fuel_type': 'electric', 'odometer': 5322, 'odometer_reading_unit': 'mi', 'registration_date': '2024-03-14', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/gwm%20ora/03?id=3667925', 'location': 'bristol', 'origin_country_code': 'gb', 'trim': '126kw pure+ 48kwh 5dr auto', 'license_plate': 'bn24vke', 'year': 2024, 'listing': 'auction', 'c_o_2_emission_value': 0, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0003667925-01980019-004.pdf', 'expiration_date': '2025-12-09t09:00:00z', 'is_vat_deductible': True, 'is_vat_included': False, 'id': '742a8c72-329e-5c3e-ab70-9041f08bc2a7', 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_expert_report_file_f9ff82fc-1644-4bbf-b350-b4232efe3a02.pdf', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_0.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_ext_7.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 198602}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_1.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_ext_7.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 198602}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_2.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_ext_6.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 251203}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_3.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_ext_1.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 187010}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_4.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_5.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 206049}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_5.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_4.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 183993}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_6.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_11.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 182319}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_7.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_10.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 197787}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_8.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_9.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 216119}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_9.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_ext_2.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 283628}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_10.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_ext_5.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 224571}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_11.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_ext_3.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 249595}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_12.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_ext_4.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 178250}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_13.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3667925-4004533-13.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 316445}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_14.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3667925-4004533-1000.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 227558}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_15.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3667925-4004533-1001.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 372348}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_16.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3667925-4004533-1002.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 391448}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_17.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3667925-4004533-1003.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 302543}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_18.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3667925-4004533-1004.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 196908}], 'current_year_diff': 1, 'age_in_months': 20, 'make_model': 'gwm ora 03', 'sanitized_make': 'gwmora', 'odometer_in_km': 8564} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 20,
     'auction_title': '',
     'c_o_2_emission_value': 0,
     'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_expert_report_file_f9ff82fc-1644-4bbf-b350-b4232efe3a02.pdf',
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0003667925-01980019-004.pdf',
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 1,
     'engine': '0.0l',
     'expiration_date': '2025-12-09t09:00:00z',
     'fuel_type': 'electric',
     'id': '742a8c72-329e-5c3e-ab70-9041f08bc2a7',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'bn24vke',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/gwm%20ora/03?id=3667925',
     'listing': 'auction',
     'location': 'bristol',
     'make': 'gwm ora',
     'make_model': 'gwm ora 03',
     'model': '03',
     'odometer': 5322,
     'odometer_in_km': 8564,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 19,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 198602,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_ext_7.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 198602,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_ext_7.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 251203,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_ext_6.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 187010,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_ext_1.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 206049,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_5.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 183993,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_4.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 182319,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_11.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 197787,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_10.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 216119,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_9.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 283628,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_ext_2.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 224571,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_ext_5.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 249595,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_ext_3.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 178250,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_ext_4.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 316445,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3667925-4004533-13.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 227558,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3667925-4004533-1000.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_15.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 372348,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3667925-4004533-1001.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_16.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 391448,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3667925-4004533-1002.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_17.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 302543,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3667925-4004533-1003.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_18.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 196908,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3667925-4004533-1004.jpg',
                 'Width': 1333}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2024-03-14',
     'sanitized_make': 'gwmora',
     'seller_name': 'novuna vehicle solutions',
     'title': 'gwm ora 03 126kw pure+ 48kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '126kw pure+ 48kwh 5dr auto',
     'year': 2024}
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_expert_report_file_f9ff82fc-1644-4bbf-b350-b4232efe3a02.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003667925-01980019-004.pdf',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '0.0L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Electric',
 'id': '742a8c72-329e-5c3e-ab70-9041f08bc2a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'BN24VKE',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/GWM%20ORA/03?id=3667925',
 'listing': 'auction',
 'location': 'Bristol',
 'make': 'GWM ORA',
 'model': '03',
 'odometer': 5322,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 198602,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 198602,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 251203,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 187010,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 206049,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 183993,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 182319,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 197787,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 216119,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 283628,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 224571,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 249595,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 178250,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7771ef22-bf10-41ca-8823-6cd0d55ba8c1_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 316445,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3667925-4004533-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 227558,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3667925-4004533-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 372348,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3667925-4004533-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 391448,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3667925-4004533-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 302543,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3667925-4004533-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742a8c72-329e-5c3e-ab70-9041f08bc2a7/742a8c72-329e-5c3e-ab70-9041f08bc2a7_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 196908,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3667925-4004533-1004.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-03-14',
 'seller_name': 'Novuna Vehicle Solutions',
 'title': 'GWM ORA 03 126kW Pure+ 48kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '126kW Pure+ 48kWh 5dr Auto',
 'year': 2024}
2025-12-04 10:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273667925%27 HTTP/1.1" 200 None
2025-12-04 10:03:38 [manheim.gb] INFO: Saving data for 3667925: {'created_time': 1764842618.318558, 'last_price_update_time': 1764842618.318567, 'auction_closing_time': 1765270800.0}
2025-12-04 10:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3667925') HTTP/1.1" 204 0
2025-12-04 10:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/Img-6ad0c061-2b75-4079-9bc4-524c2d24ce03.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003060716-01984777-003.pdf)
2025-12-04 10:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/Img-a436c597-756a-4ea1-af9a-aad59a692e0a.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002606673-01991003-001.pdf)
2025-12-04 10:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/Img-5cc8571f-9b80-466d-aed1-79483aeaf8d9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003060716-01984777-003.pdf)
2025-12-04 10:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/Img-72f616ce-71df-4325-bd2c-ee70985ba07d.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002606673-01991003-001.pdf)
2025-12-04 10:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/Img-c66eb974-16b3-4fd7-b2bb-6a54cf828827.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002606673-01991003-001.pdf)
2025-12-04 10:03:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccfbdd50>
2025-12-04 10:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bd84f78-b040-546f-bd31-1f239321937f/9bd84f78-b040-546f-bd31-1f239321937f_expert_report_file_aa55fa80-9f9f-48ca-a624-40d0bfd388d2.pdf HTTP/1.1" 201 0
2025-12-04 10:03:38 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 9bd84f78-b040-546f-bd31-1f239321937f
2025-12-04 10:03:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9bd84f78-b040-546f-bd31-1f239321937f, skipping ID generation
2025-12-04 10:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 9bd84f78-b040-546f-bd31-1f239321937f
2025-12-04 10:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F965b4c08-f785-42a1-a195-003fbb6a7591_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/965b4c08-f785-42a1-a195-003fbb6a7591_ext_7.jpg not downloaded yet
2025-12-04 10:03:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccef2650>
2025-12-04 10:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa/a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa_expert_report_file_268333e1-5d2f-4694-8064-fe3d09300836.pdf HTTP/1.1" 201 0
2025-12-04 10:03:39 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa
2025-12-04 10:03:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa, skipping ID generation
2025-12-04 10:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 19 photos for item a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa
2025-12-04 10:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb0e78064-bba9-4c47-8b33-8e461a1548ff_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b0e78064-bba9-4c47-8b33-8e461a1548ff_ext_7.jpg not downloaded yet
2025-12-04 10:03:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc673b10>
2025-12-04 10:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f42018c-b167-5adb-8c09-c35c5ecb3c4e/9f42018c-b167-5adb-8c09-c35c5ecb3c4e_image_17.jpg HTTP/1.1" 201 0
2025-12-04 10:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3060716-3999638-1003.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3060716-3999638-1003.jpg saved to cache
2025-12-04 10:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 9f42018c-b167-5adb-8c09-c35c5ecb3c4e
2025-12-04 10:03:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc58e510>
2025-12-04 10:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f42018c-b167-5adb-8c09-c35c5ecb3c4e/9f42018c-b167-5adb-8c09-c35c5ecb3c4e_image_15.jpg HTTP/1.1" 201 0
2025-12-04 10:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3060716-3999638-1001.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3060716-3999638-1001.jpg saved to cache
2025-12-04 10:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 9f42018c-b167-5adb-8c09-c35c5ecb3c4e
2025-12-04 10:03:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cceb2f50>
2025-12-04 10:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f42018c-b167-5adb-8c09-c35c5ecb3c4e/9f42018c-b167-5adb-8c09-c35c5ecb3c4e_image_14.jpg HTTP/1.1" 201 0
2025-12-04 10:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3060716-3999638-1000.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3060716-3999638-1000.jpg saved to cache
2025-12-04 10:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 9f42018c-b167-5adb-8c09-c35c5ecb3c4e
2025-12-04 10:03:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd135d0>
2025-12-04 10:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5788230a-dad4-5181-a72c-7c5ccf52b954/5788230a-dad4-5181-a72c-7c5ccf52b954_image_0.jpg HTTP/1.1" 201 0
2025-12-04 10:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4e0f13bc-e8b8-41f6-aeda-db604f626472_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4e0f13bc-e8b8-41f6-aeda-db604f626472_ext_7.jpg saved to cache
2025-12-04 10:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5788230a-dad4-5181-a72c-7c5ccf52b954
2025-12-04 10:03:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5788230a-dad4-5181-a72c-7c5ccf52b954, skipping ID generation
2025-12-04 10:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 5788230a-dad4-5181-a72c-7c5ccf52b954 from tracking dictionaries
2025-12-04 10:03:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5788230a-dad4-5181-a72c-7c5ccf52b954 sending to next pipeline
2025-12-04 10:03:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 5788230a-dad4-5181-a72c-7c5ccf52b954, identifier: 3657400
2025-12-04 10:03:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6fe9d0>
2025-12-04 10:03:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f42018c-b167-5adb-8c09-c35c5ecb3c4e/9f42018c-b167-5adb-8c09-c35c5ecb3c4e_image_16.jpg HTTP/1.1" 201 0
2025-12-04 10:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3060716-3999638-1002.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3060716-3999638-1002.jpg saved to cache
2025-12-04 10:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 9f42018c-b167-5adb-8c09-c35c5ecb3c4e
2025-12-04 10:03:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc602b10>
2025-12-04 10:03:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f42018c-b167-5adb-8c09-c35c5ecb3c4e/9f42018c-b167-5adb-8c09-c35c5ecb3c4e_image_13.jpg HTTP/1.1" 201 0
2025-12-04 10:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3060716-3999638-13.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3060716-3999638-13.jpg saved to cache
2025-12-04 10:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 9f42018c-b167-5adb-8c09-c35c5ecb3c4e
2025-12-04 10:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/Img-8c3acb07-0029-4c94-97fb-b6e70223a563.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003060716-01984777-003.pdf)
2025-12-04 10:03:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 5788230a-dad4-5181-a72c-7c5ccf52b954 with identifier: 3657400
2025-12-04 10:03:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 5788230a-dad4-5181-a72c-7c5ccf52b954 with identifier: 3657400
2025-12-04 10:03:41 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 5788230a-dad4-5181-a72c-7c5ccf52b954 with identifier: 3657400 to the API
2025-12-04 10:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 10:03:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 10:03:41 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/4e0f13bc-e8b8-41f6-aeda-db604f626472_ext_7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5788230a-dad4-5181-a72c-7c5ccf52b954/5788230a-dad4-5181-a72c-7c5ccf52b954_expert_report_file_4545803a-e449-4bfd-8e4b-a0fa510e2042.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003657400-01990798-001.pdf',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '1.0L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '5788230a-dad4-5181-a72c-7c5ccf52b954',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'YB71CVR',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/NISSAN/JUKE?id=3657400',
 'listing': 'auction',
 'location': 'Leeds',
 'make': 'NISSAN',
 'model': 'JUKE',
 'odometer': 22815,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 25,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5788230a-dad4-5181-a72c-7c5ccf52b954/5788230a-dad4-5181-a72c-7c5ccf52b954_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 216492,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4e0f13bc-e8b8-41f6-aeda-db604f626472_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5788230a-dad4-5181-a72c-7c5ccf52b954/5788230a-dad4-5181-a72c-7c5ccf52b954_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 216492,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4e0f13bc-e8b8-41f6-aeda-db604f626472_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5788230a-dad4-5181-a72c-7c5ccf52b954/5788230a-dad4-5181-a72c-7c5ccf52b954_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 246802,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4e0f13bc-e8b8-41f6-aeda-db604f626472_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5788230a-dad4-5181-a72c-7c5ccf52b954/5788230a-dad4-5181-a72c-7c5ccf52b954_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 199856,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4e0f13bc-e8b8-41f6-aeda-db604f626472_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5788230a-dad4-5181-a72c-7c5ccf52b954/5788230a-dad4-5181-a72c-7c5ccf52b954_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 208905,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4e0f13bc-e8b8-41f6-aeda-db604f626472_5.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5788230a-dad4-5181-a72c-7c5ccf52b954/5788230a-dad4-5181-a72c-7c5ccf52b954_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 222213,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4e0f13bc-e8b8-41f6-aeda-db604f626472_4.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5788230a-dad4-5181-a72c-7c5ccf52b954/5788230a-dad4-5181-a72c-7c5ccf52b954_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 210386,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4e0f13bc-e8b8-41f6-aeda-db604f626472_11.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5788230a-dad4-5181-a72c-7c5ccf52b954/5788230a-dad4-5181-a72c-7c5ccf52b954_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 217946,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4e0f13bc-e8b8-41f6-aeda-db604f626472_10.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5788230a-dad4-5181-a72c-7c5ccf52b954/5788230a-dad4-5181-a72c-7c5ccf52b954_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 231320,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4e0f13bc-e8b8-41f6-aeda-db604f626472_9.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5788230a-dad4-5181-a72c-7c5ccf52b954/5788230a-dad4-5181-a72c-7c5ccf52b954_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 288790,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4e0f13bc-e8b8-41f6-aeda-db604f626472_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5788230a-dad4-5181-a72c-7c5ccf52b954/5788230a-dad4-5181-a72c-7c5ccf52b954_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 231096,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4e0f13bc-e8b8-41f6-aeda-db604f626472_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5788230a-dad4-5181-a72c-7c5ccf52b954/5788230a-dad4-5181-a72c-7c5ccf52b954_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 250599,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4e0f13bc-e8b8-41f6-aeda-db604f626472_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5788230a-dad4-5181-a72c-7c5ccf52b954/5788230a-dad4-5181-a72c-7c5ccf52b954_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 263384,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4e0f13bc-e8b8-41f6-aeda-db604f626472_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5788230a-dad4-5181-a72c-7c5ccf52b954/5788230a-dad4-5181-a72c-7c5ccf52b954_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 441682,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3657400-4002829-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5788230a-dad4-5181-a72c-7c5ccf52b954/5788230a-dad4-5181-a72c-7c5ccf52b954_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 200386,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3657400-4002829-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5788230a-dad4-5181-a72c-7c5ccf52b954/5788230a-dad4-5181-a72c-7c5ccf52b954_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 282293,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3657400-4002829-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5788230a-dad4-5181-a72c-7c5ccf52b954/5788230a-dad4-5181-a72c-7c5ccf52b954_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 363277,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3657400-4002829-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5788230a-dad4-5181-a72c-7c5ccf52b954/5788230a-dad4-5181-a72c-7c5ccf52b954_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 299371,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3657400-4002829-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5788230a-dad4-5181-a72c-7c5ccf52b954/5788230a-dad4-5181-a72c-7c5ccf52b954_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 257869,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3657400-4002829-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5788230a-dad4-5181-a72c-7c5ccf52b954/5788230a-dad4-5181-a72c-7c5ccf52b954_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 446511,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3657400-4002829-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-23',
 'seller_name': 'Mobilize Financial Services',
 'title': 'NISSAN JUKE 1.0 DiG-T 114 N-Connecta 5dr',
 'transmission': 'manual',
 'trim': '1.0 DiG-T 114 N-Connecta 5dr',
 'year': 2021}
2025-12-04 10:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273657400%27 HTTP/1.1" 200 None
2025-12-04 10:03:41 [manheim.gb] INFO: Saving data for 3657400: {'created_time': 1764842621.539699, 'last_price_update_time': 1764842621.53971, 'auction_closing_time': 1765184400.0}
2025-12-04 10:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3657400') HTTP/1.1" 204 0
2025-12-04 10:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F965b4c08-f785-42a1-a195-003fbb6a7591_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/965b4c08-f785-42a1-a195-003fbb6a7591_ext_7.jpg not downloaded yet
2025-12-04 10:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb0e78064-bba9-4c47-8b33-8e461a1548ff_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b0e78064-bba9-4c47-8b33-8e461a1548ff_ext_7.jpg not downloaded yet
2025-12-04 10:03:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccfa85d0>
2025-12-04 10:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f42018c-b167-5adb-8c09-c35c5ecb3c4e/9f42018c-b167-5adb-8c09-c35c5ecb3c4e_image_11.jpg HTTP/1.1" 201 0
2025-12-04 10:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-6ad0c061-2b75-4079-9bc4-524c2d24ce03.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-6ad0c061-2b75-4079-9bc4-524c2d24ce03.jpg saved to cache
2025-12-04 10:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 9f42018c-b167-5adb-8c09-c35c5ecb3c4e
2025-12-04 10:03:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd01dc10>
2025-12-04 10:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_591f2d53-8462-59fd-a965-443e232a08fb/591f2d53-8462-59fd-a965-443e232a08fb_image_3.jpg HTTP/1.1" 201 0
2025-12-04 10:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-a436c597-756a-4ea1-af9a-aad59a692e0a.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-a436c597-756a-4ea1-af9a-aad59a692e0a.jpg saved to cache
2025-12-04 10:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 591f2d53-8462-59fd-a965-443e232a08fb
2025-12-04 10:03:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc56ed10>
2025-12-04 10:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f42018c-b167-5adb-8c09-c35c5ecb3c4e/9f42018c-b167-5adb-8c09-c35c5ecb3c4e_image_10.jpg HTTP/1.1" 201 0
2025-12-04 10:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-5cc8571f-9b80-466d-aed1-79483aeaf8d9.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-5cc8571f-9b80-466d-aed1-79483aeaf8d9.jpg saved to cache
2025-12-04 10:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 9f42018c-b167-5adb-8c09-c35c5ecb3c4e
2025-12-04 10:03:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc56f850>
2025-12-04 10:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_591f2d53-8462-59fd-a965-443e232a08fb/591f2d53-8462-59fd-a965-443e232a08fb_image_2.jpg HTTP/1.1" 201 0
2025-12-04 10:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-72f616ce-71df-4325-bd2c-ee70985ba07d.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-72f616ce-71df-4325-bd2c-ee70985ba07d.jpg saved to cache
2025-12-04 10:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 591f2d53-8462-59fd-a965-443e232a08fb
2025-12-04 10:03:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ce627a50>
2025-12-04 10:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_591f2d53-8462-59fd-a965-443e232a08fb/591f2d53-8462-59fd-a965-443e232a08fb_image_0.jpg HTTP/1.1" 201 0
2025-12-04 10:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-c66eb974-16b3-4fd7-b2bb-6a54cf828827.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-c66eb974-16b3-4fd7-b2bb-6a54cf828827.jpg saved to cache
2025-12-04 10:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 591f2d53-8462-59fd-a965-443e232a08fb
2025-12-04 10:03:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 591f2d53-8462-59fd-a965-443e232a08fb, skipping ID generation
2025-12-04 10:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 591f2d53-8462-59fd-a965-443e232a08fb from tracking dictionaries
2025-12-04 10:03:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 591f2d53-8462-59fd-a965-443e232a08fb sending to next pipeline
2025-12-04 10:03:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 591f2d53-8462-59fd-a965-443e232a08fb, identifier: 2606673
2025-12-04 10:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3367434-4001907-1002.jpg> (referer: None)
2025-12-04 10:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F965b4c08-f785-42a1-a195-003fbb6a7591_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/965b4c08-f785-42a1-a195-003fbb6a7591_ext_6.jpg not downloaded yet
2025-12-04 10:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb0e78064-bba9-4c47-8b33-8e461a1548ff_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b0e78064-bba9-4c47-8b33-8e461a1548ff_ext_6.jpg not downloaded yet
2025-12-04 10:03:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 591f2d53-8462-59fd-a965-443e232a08fb with identifier: 2606673
2025-12-04 10:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-04 10:03:43 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=RED HTTP/1.1" 200 None
2025-12-04 10:03:43 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-04 10:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-04 10:03:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 591f2d53-8462-59fd-a965-443e232a08fb with identifier: 2606673
2025-12-04 10:03:43 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 188476 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    188476
2025-12-04 10:03:43 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 591f2d53-8462-59fd-a965-443e232a08fb spider: manheim.gb
2025-12-04 10:03:43 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 591f2d53-8462-59fd-a965-443e232a08fb due to rule: high_mileage_for_country.json, error: 188476 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    188476
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_591f2d53-8462-59fd-a965-443e232a08fb/591f2d53-8462-59fd-a965-443e232a08fb_expert_report_file_60cb399b-b279-435f-9c53-c708cb50c4a1.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002606673-01991003-001.pdf',
 'color': 'RED',
 'currency': 'GBP',
 'engine': '2.2L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '591f2d53-8462-59fd-a965-443e232a08fb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'YR17WNS',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MAZDA/CX-5?id=2606673',
 'listing': 'auction',
 'location': 'Leeds',
 'make': 'MAZDA',
 'model': 'CX-5',
 'odometer': 117114,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 38,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_591f2d53-8462-59fd-a965-443e232a08fb/591f2d53-8462-59fd-a965-443e232a08fb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 173676,
             'Height': 996,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/Img-c66eb974-16b3-4fd7-b2bb-6a54cf828827.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_591f2d53-8462-59fd-a965-443e232a08fb/591f2d53-8462-59fd-a965-443e232a08fb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 207899,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/002f07fd-9e73-4e00-b832-1673528a4d8b_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_591f2d53-8462-59fd-a965-443e232a08fb/591f2d53-8462-59fd-a965-443e232a08fb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 169319,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/Img-72f616ce-71df-4325-bd2c-ee70985ba07d.jpg',
             'Width': 963},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_591f2d53-8462-59fd-a965-443e232a08fb/591f2d53-8462-59fd-a965-443e232a08fb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 201227,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/Img-a436c597-756a-4ea1-af9a-aad59a692e0a.jpg',
             'Width': 762},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_591f2d53-8462-59fd-a965-443e232a08fb/591f2d53-8462-59fd-a965-443e232a08fb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91450,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/Img-504a4ec2-6285-4511-901a-44a10da763c1.jpg',
             'Width': 677},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_591f2d53-8462-59fd-a965-443e232a08fb/591f2d53-8462-59fd-a965-443e232a08fb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106358,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/Img-365ae7ee-76b4-428e-b923-2972a12d6cc0.jpg',
             'Width': 705},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_591f2d53-8462-59fd-a965-443e232a08fb/591f2d53-8462-59fd-a965-443e232a08fb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 146840,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/Img-af5ba8d6-b869-47dd-8a04-4395a99d3b3e.jpg',
             'Width': 726},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_591f2d53-8462-59fd-a965-443e232a08fb/591f2d53-8462-59fd-a965-443e232a08fb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 128498,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/Img-3186d138-2acb-442c-b9f0-b2b6a3d8932d.jpg',
             'Width': 716},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_591f2d53-8462-59fd-a965-443e232a08fb/591f2d53-8462-59fd-a965-443e232a08fb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101652,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/Img-fdf7af1a-df53-4751-87e2-563938e70f2d.jpg',
             'Width': 710},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_591f2d53-8462-59fd-a965-443e232a08fb/591f2d53-8462-59fd-a965-443e232a08fb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 148656,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/Img-72528756-f2f7-48a0-bf9a-83b694039cbf.jpg',
             'Width': 721},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_591f2d53-8462-59fd-a965-443e232a08fb/591f2d53-8462-59fd-a965-443e232a08fb_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 145084,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/Img-c20d1bcd-2eab-48c9-a9ec-a1e8570143ac.jpg',
             'Width': 705},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_591f2d53-8462-59fd-a965-443e232a08fb/591f2d53-8462-59fd-a965-443e232a08fb_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 143843,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/Img-70cdf250-cd0f-4680-b5aa-0426870b7c39.jpg',
             'Width': 1158},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_591f2d53-8462-59fd-a965-443e232a08fb/591f2d53-8462-59fd-a965-443e232a08fb_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 229275,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/Img-da42237d-7899-4c54-92f5-3b6bc6970393.jpg',
             'Width': 1494},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_591f2d53-8462-59fd-a965-443e232a08fb/591f2d53-8462-59fd-a965-443e232a08fb_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 257716,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2606673-4007468-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_591f2d53-8462-59fd-a965-443e232a08fb/591f2d53-8462-59fd-a965-443e232a08fb_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 163707,
             'Height': 996,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/Img-888eb2d2-a2a7-4128-a747-47e633a3a0c3.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_591f2d53-8462-59fd-a965-443e232a08fb/591f2d53-8462-59fd-a965-443e232a08fb_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 249097,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/Img-50f8c906-5338-4442-8e33-c183d7d929fe.jpg',
             'Width': 1494},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_591f2d53-8462-59fd-a965-443e232a08fb/591f2d53-8462-59fd-a965-443e232a08fb_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 302473,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/Img-16f74130-396f-463b-bb4f-8dfbcda0313e.jpg',
             'Width': 1494},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_591f2d53-8462-59fd-a965-443e232a08fb/591f2d53-8462-59fd-a965-443e232a08fb_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 268197,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/Img-e2985488-1bf9-40ee-9c44-5622eaac624e.jpg',
             'Width': 1494},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_591f2d53-8462-59fd-a965-443e232a08fb/591f2d53-8462-59fd-a965-443e232a08fb_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 275885,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/Img-259a7a11-ca0a-47c2-aec8-1e6b91c08805.jpg',
             'Width': 1494},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_591f2d53-8462-59fd-a965-443e232a08fb/591f2d53-8462-59fd-a965-443e232a08fb_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 158373,
             'Height': 996,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/Img-386cdcaa-d619-46ec-868a-78a03e00e377.jpg',
             'Width': 1500}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-28',
 'seller_name': 'Big Motoring World Ltd',
 'title': 'MAZDA CX-5 2.2d Sport Nav 5dr',
 'transmission': 'manual',
 'trim': '2.2d Sport Nav 5dr',
 'year': 2017}
2025-12-04 10:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272606673%27 HTTP/1.1" 200 None
2025-12-04 10:03:43 [manheim.gb] INFO: Saving data for 2606673: {'created_time': 1764842623.602396, 'last_price_update_time': 1764842623.602405, 'auction_closing_time': 1765184400.0}
2025-12-04 10:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2606673') HTTP/1.1" 204 0
2025-12-04 10:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3367434-4001907-1003.jpg> (referer: None)
2025-12-04 10:03:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc61b010>
2025-12-04 10:03:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f42018c-b167-5adb-8c09-c35c5ecb3c4e/9f42018c-b167-5adb-8c09-c35c5ecb3c4e_image_12.jpg HTTP/1.1" 201 0
2025-12-04 10:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-8c3acb07-0029-4c94-97fb-b6e70223a563.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-8c3acb07-0029-4c94-97fb-b6e70223a563.jpg saved to cache
2025-12-04 10:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 9f42018c-b167-5adb-8c09-c35c5ecb3c4e
2025-12-04 10:03:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9f42018c-b167-5adb-8c09-c35c5ecb3c4e, skipping ID generation
2025-12-04 10:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 9f42018c-b167-5adb-8c09-c35c5ecb3c4e from tracking dictionaries
2025-12-04 10:03:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9f42018c-b167-5adb-8c09-c35c5ecb3c4e sending to next pipeline
2025-12-04 10:03:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 9f42018c-b167-5adb-8c09-c35c5ecb3c4e, identifier: 3060716
2025-12-04 10:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3367434-4001907-1001.jpg> (referer: None)
2025-12-04 10:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3367434-4001907-1000.jpg> (referer: None)
2025-12-04 10:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3367434-4001907-43.jpg> (referer: None)
2025-12-04 10:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3367434-4001907-42.jpg> (referer: None)
2025-12-04 10:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F965b4c08-f785-42a1-a195-003fbb6a7591_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/965b4c08-f785-42a1-a195-003fbb6a7591_ext_1.jpg not downloaded yet
2025-12-04 10:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb0e78064-bba9-4c47-8b33-8e461a1548ff_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b0e78064-bba9-4c47-8b33-8e461a1548ff_ext_1.jpg not downloaded yet
2025-12-04 10:03:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 9f42018c-b167-5adb-8c09-c35c5ecb3c4e with identifier: 3060716
2025-12-04 10:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-04 10:03:44 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=SILVER HTTP/1.1" 200 None
2025-12-04 10:03:44 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-04 10:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-04 10:03:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 9f42018c-b167-5adb-8c09-c35c5ecb3c4e with identifier: 3060716
2025-12-04 10:03:44 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 9f42018c-b167-5adb-8c09-c35c5ecb3c4e with identifier: 3060716 to the API
2025-12-04 10:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 10:03:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 10:03:44 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/Img-8c3acb07-0029-4c94-97fb-b6e70223a563.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 189,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f42018c-b167-5adb-8c09-c35c5ecb3c4e/9f42018c-b167-5adb-8c09-c35c5ecb3c4e_expert_report_file_a05c32c4-704b-4288-afe9-64d01eb3c7bc.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003060716-01984777-003.pdf',
 'color': 'SILVER',
 'currency': 'GBP',
 'engine': '3.0L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '9f42018c-b167-5adb-8c09-c35c5ecb3c4e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'SW17XUS',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/LAND%20ROVER/DISCOVERY?id=3060716',
 'listing': 'auction',
 'location': 'Shotts',
 'make': 'LAND ROVER',
 'model': 'DISCOVERY',
 'odometer': 80281,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f42018c-b167-5adb-8c09-c35c5ecb3c4e/9f42018c-b167-5adb-8c09-c35c5ecb3c4e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 214436,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/Img-2f924e8d-d62a-4a89-a701-41924ecc4d17.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f42018c-b167-5adb-8c09-c35c5ecb3c4e/9f42018c-b167-5adb-8c09-c35c5ecb3c4e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 240592,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5e2d86aa-395c-4447-8bf7-70e147db327b_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f42018c-b167-5adb-8c09-c35c5ecb3c4e/9f42018c-b167-5adb-8c09-c35c5ecb3c4e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 223282,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/Img-265d3591-2670-4590-aea2-865ffa36b8b7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f42018c-b167-5adb-8c09-c35c5ecb3c4e/9f42018c-b167-5adb-8c09-c35c5ecb3c4e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 247802,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/Img-b477366c-59e8-422c-ba41-5bf09207bb35.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f42018c-b167-5adb-8c09-c35c5ecb3c4e/9f42018c-b167-5adb-8c09-c35c5ecb3c4e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 225484,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/Img-4a334bed-6c4f-468e-954e-bcbfaa34abd2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f42018c-b167-5adb-8c09-c35c5ecb3c4e/9f42018c-b167-5adb-8c09-c35c5ecb3c4e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 206860,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/Img-de389bfc-b38e-49da-8f41-c927fe6c5e16.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f42018c-b167-5adb-8c09-c35c5ecb3c4e/9f42018c-b167-5adb-8c09-c35c5ecb3c4e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 192851,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/Img-368f7401-f46a-4453-a68b-91ea8d5bbf8e.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f42018c-b167-5adb-8c09-c35c5ecb3c4e/9f42018c-b167-5adb-8c09-c35c5ecb3c4e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 203345,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/Img-fa789e84-2112-46ec-b99a-848e198fbea3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f42018c-b167-5adb-8c09-c35c5ecb3c4e/9f42018c-b167-5adb-8c09-c35c5ecb3c4e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 213256,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/Img-642bbd64-0b79-43b9-955c-da1423b76560.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f42018c-b167-5adb-8c09-c35c5ecb3c4e/9f42018c-b167-5adb-8c09-c35c5ecb3c4e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 263704,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/Img-b1af6041-50c0-4844-9783-e56c74676da2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f42018c-b167-5adb-8c09-c35c5ecb3c4e/9f42018c-b167-5adb-8c09-c35c5ecb3c4e_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 244838,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/Img-5cc8571f-9b80-466d-aed1-79483aeaf8d9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f42018c-b167-5adb-8c09-c35c5ecb3c4e/9f42018c-b167-5adb-8c09-c35c5ecb3c4e_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 225409,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/Img-6ad0c061-2b75-4079-9bc4-524c2d24ce03.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f42018c-b167-5adb-8c09-c35c5ecb3c4e/9f42018c-b167-5adb-8c09-c35c5ecb3c4e_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 280791,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/Img-8c3acb07-0029-4c94-97fb-b6e70223a563.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f42018c-b167-5adb-8c09-c35c5ecb3c4e/9f42018c-b167-5adb-8c09-c35c5ecb3c4e_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 303379,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3060716-3999638-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f42018c-b167-5adb-8c09-c35c5ecb3c4e/9f42018c-b167-5adb-8c09-c35c5ecb3c4e_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 252462,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3060716-3999638-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f42018c-b167-5adb-8c09-c35c5ecb3c4e/9f42018c-b167-5adb-8c09-c35c5ecb3c4e_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 163744,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3060716-3999638-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f42018c-b167-5adb-8c09-c35c5ecb3c4e/9f42018c-b167-5adb-8c09-c35c5ecb3c4e_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 286124,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3060716-3999638-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f42018c-b167-5adb-8c09-c35c5ecb3c4e/9f42018c-b167-5adb-8c09-c35c5ecb3c4e_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 181100,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3060716-3999638-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f42018c-b167-5adb-8c09-c35c5ecb3c4e/9f42018c-b167-5adb-8c09-c35c5ecb3c4e_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 309123,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3060716-3999638-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f42018c-b167-5adb-8c09-c35c5ecb3c4e/9f42018c-b167-5adb-8c09-c35c5ecb3c4e_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 235937,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3060716-3999638-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-18',
 'seller_name': 'Lookers',
 'title': 'LAND ROVER DISCOVERY 3.0 TD6 HSE 5dr Auto',
 'transmission': 'automatic',
 'trim': '3.0 TD6 HSE 5dr Auto',
 'year': 2017}
2025-12-04 10:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273060716%27 HTTP/1.1" 200 None
2025-12-04 10:03:44 [manheim.gb] INFO: Saving data for 3060716: {'created_time': 1764842624.790587, 'last_price_update_time': 1764842624.7906, 'auction_closing_time': 1765270800.0}
2025-12-04 10:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3060716') HTTP/1.1" 204 0
2025-12-04 10:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3367434-4001907-44.jpg> (referer: None)
2025-12-04 10:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F965b4c08-f785-42a1-a195-003fbb6a7591_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/965b4c08-f785-42a1-a195-003fbb6a7591_5.jpg not downloaded yet
2025-12-04 10:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb0e78064-bba9-4c47-8b33-8e461a1548ff_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b0e78064-bba9-4c47-8b33-8e461a1548ff_5.jpg not downloaded yet
2025-12-04 10:03:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc67fbd0>
2025-12-04 10:03:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 10:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4852c08-cf28-561f-aac7-d251292092ad/f4852c08-cf28-561f-aac7-d251292092ad_image_15.jpg HTTP/1.1" 201 0
2025-12-04 10:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3367434-4001907-1002.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3367434-4001907-1002.jpg saved to cache
2025-12-04 10:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item f4852c08-cf28-561f-aac7-d251292092ad
2025-12-04 10:03:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6180d0>
2025-12-04 10:03:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4852c08-cf28-561f-aac7-d251292092ad/f4852c08-cf28-561f-aac7-d251292092ad_image_16.jpg HTTP/1.1" 201 0
2025-12-04 10:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3367434-4001907-1003.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3367434-4001907-1003.jpg saved to cache
2025-12-04 10:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item f4852c08-cf28-561f-aac7-d251292092ad
2025-12-04 10:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F965b4c08-f785-42a1-a195-003fbb6a7591_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/965b4c08-f785-42a1-a195-003fbb6a7591_4.jpg not downloaded yet
2025-12-04 10:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb0e78064-bba9-4c47-8b33-8e461a1548ff_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b0e78064-bba9-4c47-8b33-8e461a1548ff_4.jpg not downloaded yet
2025-12-04 10:03:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ce625a90>
2025-12-04 10:03:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4852c08-cf28-561f-aac7-d251292092ad/f4852c08-cf28-561f-aac7-d251292092ad_image_14.jpg HTTP/1.1" 201 0
2025-12-04 10:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3367434-4001907-1001.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3367434-4001907-1001.jpg saved to cache
2025-12-04 10:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item f4852c08-cf28-561f-aac7-d251292092ad
2025-12-04 10:03:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6e0d90>
2025-12-04 10:03:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4852c08-cf28-561f-aac7-d251292092ad/f4852c08-cf28-561f-aac7-d251292092ad_image_13.jpg HTTP/1.1" 201 0
2025-12-04 10:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3367434-4001907-1000.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3367434-4001907-1000.jpg saved to cache
2025-12-04 10:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item f4852c08-cf28-561f-aac7-d251292092ad
2025-12-04 10:03:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf83450>
2025-12-04 10:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4852c08-cf28-561f-aac7-d251292092ad/f4852c08-cf28-561f-aac7-d251292092ad_image_11.jpg HTTP/1.1" 201 0
2025-12-04 10:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3367434-4001907-43.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3367434-4001907-43.jpg saved to cache
2025-12-04 10:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item f4852c08-cf28-561f-aac7-d251292092ad
2025-12-04 10:03:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cccd8250>
2025-12-04 10:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4852c08-cf28-561f-aac7-d251292092ad/f4852c08-cf28-561f-aac7-d251292092ad_image_10.jpg HTTP/1.1" 201 0
2025-12-04 10:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3367434-4001907-42.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3367434-4001907-42.jpg saved to cache
2025-12-04 10:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item f4852c08-cf28-561f-aac7-d251292092ad
2025-12-04 10:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3367434-4001907-28.jpg> (referer: None)
2025-12-04 10:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3367434-4001907-16.jpg> (referer: None)
2025-12-04 10:03:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd0c3550>
2025-12-04 10:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4852c08-cf28-561f-aac7-d251292092ad/f4852c08-cf28-561f-aac7-d251292092ad_image_12.jpg HTTP/1.1" 201 0
2025-12-04 10:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3367434-4001907-44.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3367434-4001907-44.jpg saved to cache
2025-12-04 10:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item f4852c08-cf28-561f-aac7-d251292092ad
2025-12-04 10:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3367434-4001907-15.jpg> (referer: None)
2025-12-04 10:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/965b4c08-f785-42a1-a195-003fbb6a7591_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003682181-01988700-002.pdf)
2025-12-04 10:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/965b4c08-f785-42a1-a195-003fbb6a7591_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003682181-01988700-002.pdf)
2025-12-04 10:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F965b4c08-f785-42a1-a195-003fbb6a7591_11.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/965b4c08-f785-42a1-a195-003fbb6a7591_11.jpg not downloaded yet
2025-12-04 10:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb0e78064-bba9-4c47-8b33-8e461a1548ff_11.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b0e78064-bba9-4c47-8b33-8e461a1548ff_11.jpg not downloaded yet
2025-12-04 10:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/b0e78064-bba9-4c47-8b33-8e461a1548ff_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003684907-01969138-004.pdf)
2025-12-04 10:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/b0e78064-bba9-4c47-8b33-8e461a1548ff_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003684907-01969138-004.pdf)
2025-12-04 10:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F965b4c08-f785-42a1-a195-003fbb6a7591_10.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/965b4c08-f785-42a1-a195-003fbb6a7591_10.jpg not downloaded yet
2025-12-04 10:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb0e78064-bba9-4c47-8b33-8e461a1548ff_10.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b0e78064-bba9-4c47-8b33-8e461a1548ff_10.jpg not downloaded yet
2025-12-04 10:03:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccc80890>
2025-12-04 10:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4852c08-cf28-561f-aac7-d251292092ad/f4852c08-cf28-561f-aac7-d251292092ad_image_9.jpg HTTP/1.1" 201 0
2025-12-04 10:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3367434-4001907-28.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3367434-4001907-28.jpg saved to cache
2025-12-04 10:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f4852c08-cf28-561f-aac7-d251292092ad
2025-12-04 10:03:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf438d0>
2025-12-04 10:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4852c08-cf28-561f-aac7-d251292092ad/f4852c08-cf28-561f-aac7-d251292092ad_image_8.jpg HTTP/1.1" 201 0
2025-12-04 10:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3367434-4001907-16.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3367434-4001907-16.jpg saved to cache
2025-12-04 10:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f4852c08-cf28-561f-aac7-d251292092ad
2025-12-04 10:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F965b4c08-f785-42a1-a195-003fbb6a7591_9.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/965b4c08-f785-42a1-a195-003fbb6a7591_9.jpg not downloaded yet
2025-12-04 10:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb0e78064-bba9-4c47-8b33-8e461a1548ff_9.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b0e78064-bba9-4c47-8b33-8e461a1548ff_9.jpg not downloaded yet
2025-12-04 10:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F965b4c08-f785-42a1-a195-003fbb6a7591_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/965b4c08-f785-42a1-a195-003fbb6a7591_ext_2.jpg not downloaded yet
2025-12-04 10:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb0e78064-bba9-4c47-8b33-8e461a1548ff_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b0e78064-bba9-4c47-8b33-8e461a1548ff_ext_2.jpg not downloaded yet
2025-12-04 10:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3367434-4001907-8.jpg> (referer: None)
2025-12-04 10:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/965b4c08-f785-42a1-a195-003fbb6a7591_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003682181-01988700-002.pdf)
2025-12-04 10:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3367434-4001907-3.jpg> (referer: None)
2025-12-04 10:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/b0e78064-bba9-4c47-8b33-8e461a1548ff_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003684907-01969138-004.pdf)
2025-12-04 10:03:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ce627090>
2025-12-04 10:03:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4852c08-cf28-561f-aac7-d251292092ad/f4852c08-cf28-561f-aac7-d251292092ad_image_7.jpg HTTP/1.1" 201 0
2025-12-04 10:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3367434-4001907-15.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3367434-4001907-15.jpg saved to cache
2025-12-04 10:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f4852c08-cf28-561f-aac7-d251292092ad
2025-12-04 10:03:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc53fc50>
2025-12-04 10:03:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bd84f78-b040-546f-bd31-1f239321937f/9bd84f78-b040-546f-bd31-1f239321937f_image_0.jpg HTTP/1.1" 201 0
2025-12-04 10:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F965b4c08-f785-42a1-a195-003fbb6a7591_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/965b4c08-f785-42a1-a195-003fbb6a7591_ext_7.jpg saved to cache
2025-12-04 10:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9bd84f78-b040-546f-bd31-1f239321937f
2025-12-04 10:03:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc59df50>
2025-12-04 10:03:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bd84f78-b040-546f-bd31-1f239321937f/9bd84f78-b040-546f-bd31-1f239321937f_image_1.jpg HTTP/1.1" 201 0
2025-12-04 10:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F965b4c08-f785-42a1-a195-003fbb6a7591_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/965b4c08-f785-42a1-a195-003fbb6a7591_ext_7.jpg saved to cache
2025-12-04 10:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9bd84f78-b040-546f-bd31-1f239321937f
2025-12-04 10:03:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf0bd10>
2025-12-04 10:03:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa/a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa_image_0.jpg HTTP/1.1" 201 0
2025-12-04 10:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb0e78064-bba9-4c47-8b33-8e461a1548ff_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b0e78064-bba9-4c47-8b33-8e461a1548ff_ext_7.jpg saved to cache
2025-12-04 10:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa
2025-12-04 10:03:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce0b110>
2025-12-04 10:03:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:03:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa/a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa_image_1.jpg HTTP/1.1" 201 0
2025-12-04 10:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb0e78064-bba9-4c47-8b33-8e461a1548ff_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b0e78064-bba9-4c47-8b33-8e461a1548ff_ext_7.jpg saved to cache
2025-12-04 10:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa
2025-12-04 10:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3367434-4001907-2.jpg> (referer: None)
2025-12-04 10:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F965b4c08-f785-42a1-a195-003fbb6a7591_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/965b4c08-f785-42a1-a195-003fbb6a7591_ext_5.jpg not downloaded yet
2025-12-04 10:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb0e78064-bba9-4c47-8b33-8e461a1548ff_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b0e78064-bba9-4c47-8b33-8e461a1548ff_ext_5.jpg not downloaded yet
2025-12-04 10:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3367434-4001907-13.jpg> (referer: None)
2025-12-04 10:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F965b4c08-f785-42a1-a195-003fbb6a7591_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/965b4c08-f785-42a1-a195-003fbb6a7591_ext_3.jpg not downloaded yet
2025-12-04 10:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb0e78064-bba9-4c47-8b33-8e461a1548ff_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b0e78064-bba9-4c47-8b33-8e461a1548ff_ext_3.jpg not downloaded yet
2025-12-04 10:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3367434-4001907-6.jpg> (referer: None)
2025-12-04 10:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3367434-4001907-4.jpg> (referer: None)
2025-12-04 10:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F965b4c08-f785-42a1-a195-003fbb6a7591_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/965b4c08-f785-42a1-a195-003fbb6a7591_ext_4.jpg not downloaded yet
2025-12-04 10:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb0e78064-bba9-4c47-8b33-8e461a1548ff_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b0e78064-bba9-4c47-8b33-8e461a1548ff_ext_4.jpg not downloaded yet
2025-12-04 10:03:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc600bd0>
2025-12-04 10:03:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:03:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4852c08-cf28-561f-aac7-d251292092ad/f4852c08-cf28-561f-aac7-d251292092ad_image_6.jpg HTTP/1.1" 201 0
2025-12-04 10:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3367434-4001907-8.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3367434-4001907-8.jpg saved to cache
2025-12-04 10:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f4852c08-cf28-561f-aac7-d251292092ad
2025-12-04 10:03:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cccc6dd0>
2025-12-04 10:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bd84f78-b040-546f-bd31-1f239321937f/9bd84f78-b040-546f-bd31-1f239321937f_image_2.jpg HTTP/1.1" 201 0
2025-12-04 10:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F965b4c08-f785-42a1-a195-003fbb6a7591_ext_6.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/965b4c08-f785-42a1-a195-003fbb6a7591_ext_6.jpg saved to cache
2025-12-04 10:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9bd84f78-b040-546f-bd31-1f239321937f
2025-12-04 10:03:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc61aa90>
2025-12-04 10:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4852c08-cf28-561f-aac7-d251292092ad/f4852c08-cf28-561f-aac7-d251292092ad_image_2.jpg HTTP/1.1" 201 0
2025-12-04 10:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3367434-4001907-3.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3367434-4001907-3.jpg saved to cache
2025-12-04 10:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f4852c08-cf28-561f-aac7-d251292092ad
2025-12-04 10:03:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cccc7090>
2025-12-04 10:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa/a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa_image_2.jpg HTTP/1.1" 201 0
2025-12-04 10:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb0e78064-bba9-4c47-8b33-8e461a1548ff_ext_6.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b0e78064-bba9-4c47-8b33-8e461a1548ff_ext_6.jpg saved to cache
2025-12-04 10:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa
2025-12-04 10:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3682181-3993179-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3682181-3993179-13.jpg not downloaded yet
2025-12-04 10:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3684907-3995158-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3684907-3995158-13.jpg not downloaded yet
2025-12-04 10:03:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce85590>
2025-12-04 10:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4852c08-cf28-561f-aac7-d251292092ad/f4852c08-cf28-561f-aac7-d251292092ad_image_1.jpg HTTP/1.1" 201 0
2025-12-04 10:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3367434-4001907-2.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3367434-4001907-2.jpg saved to cache
2025-12-04 10:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f4852c08-cf28-561f-aac7-d251292092ad
2025-12-04 10:03:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd0d9fd0>
2025-12-04 10:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4852c08-cf28-561f-aac7-d251292092ad/f4852c08-cf28-561f-aac7-d251292092ad_image_5.jpg HTTP/1.1" 201 0
2025-12-04 10:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3367434-4001907-13.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3367434-4001907-13.jpg saved to cache
2025-12-04 10:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f4852c08-cf28-561f-aac7-d251292092ad
2025-12-04 10:03:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd0e8190>
2025-12-04 10:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4852c08-cf28-561f-aac7-d251292092ad/f4852c08-cf28-561f-aac7-d251292092ad_image_4.jpg HTTP/1.1" 201 0
2025-12-04 10:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3367434-4001907-6.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3367434-4001907-6.jpg saved to cache
2025-12-04 10:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f4852c08-cf28-561f-aac7-d251292092ad
2025-12-04 10:03:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf44a90>
2025-12-04 10:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4852c08-cf28-561f-aac7-d251292092ad/f4852c08-cf28-561f-aac7-d251292092ad_image_3.jpg HTTP/1.1" 201 0
2025-12-04 10:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3367434-4001907-4.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3367434-4001907-4.jpg saved to cache
2025-12-04 10:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f4852c08-cf28-561f-aac7-d251292092ad
2025-12-04 10:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/b0e78064-bba9-4c47-8b33-8e461a1548ff_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003684907-01969138-004.pdf)
2025-12-04 10:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/b0e78064-bba9-4c47-8b33-8e461a1548ff_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003684907-01969138-004.pdf)
2025-12-04 10:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/b0e78064-bba9-4c47-8b33-8e461a1548ff_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003684907-01969138-004.pdf)
2025-12-04 10:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/965b4c08-f785-42a1-a195-003fbb6a7591_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003682181-01988700-002.pdf)
2025-12-04 10:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/965b4c08-f785-42a1-a195-003fbb6a7591_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003682181-01988700-002.pdf)
2025-12-04 10:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/b0e78064-bba9-4c47-8b33-8e461a1548ff_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003684907-01969138-004.pdf)
2025-12-04 10:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/965b4c08-f785-42a1-a195-003fbb6a7591_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003682181-01988700-002.pdf)
2025-12-04 10:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3682181-3993179-15.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3682181-3993179-15.jpg not downloaded yet
2025-12-04 10:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3684907-3995158-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3684907-3995158-1000.jpg not downloaded yet
2025-12-04 10:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/965b4c08-f785-42a1-a195-003fbb6a7591_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003682181-01988700-002.pdf)
2025-12-04 10:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3682181-3993179-16.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3682181-3993179-16.jpg not downloaded yet
2025-12-04 10:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3684907-3995158-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3684907-3995158-1001.jpg not downloaded yet
2025-12-04 10:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3682181-3993179-28.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3682181-3993179-28.jpg not downloaded yet
2025-12-04 10:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3684907-3995158-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3684907-3995158-1002.jpg not downloaded yet
2025-12-04 10:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3682181-3993179-42.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3682181-3993179-42.jpg not downloaded yet
2025-12-04 10:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3684907-3995158-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3684907-3995158-1003.jpg not downloaded yet
2025-12-04 10:03:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccda5c10>
2025-12-04 10:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 10:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa/a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa_image_6.jpg HTTP/1.1" 201 0
2025-12-04 10:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb0e78064-bba9-4c47-8b33-8e461a1548ff_11.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b0e78064-bba9-4c47-8b33-8e461a1548ff_11.jpg saved to cache
2025-12-04 10:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa
2025-12-04 10:03:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccfad090>
2025-12-04 10:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa/a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa_image_4.jpg HTTP/1.1" 201 0
2025-12-04 10:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb0e78064-bba9-4c47-8b33-8e461a1548ff_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b0e78064-bba9-4c47-8b33-8e461a1548ff_5.jpg saved to cache
2025-12-04 10:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa
2025-12-04 10:03:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccdf62d0>
2025-12-04 10:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa/a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa_image_3.jpg HTTP/1.1" 201 0
2025-12-04 10:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb0e78064-bba9-4c47-8b33-8e461a1548ff_ext_1.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b0e78064-bba9-4c47-8b33-8e461a1548ff_ext_1.jpg saved to cache
2025-12-04 10:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa
2025-12-04 10:03:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccda4f50>
2025-12-04 10:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bd84f78-b040-546f-bd31-1f239321937f/9bd84f78-b040-546f-bd31-1f239321937f_image_4.jpg HTTP/1.1" 201 0
2025-12-04 10:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F965b4c08-f785-42a1-a195-003fbb6a7591_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/965b4c08-f785-42a1-a195-003fbb6a7591_5.jpg saved to cache
2025-12-04 10:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9bd84f78-b040-546f-bd31-1f239321937f
2025-12-04 10:03:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccca7e90>
2025-12-04 10:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 10:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bd84f78-b040-546f-bd31-1f239321937f/9bd84f78-b040-546f-bd31-1f239321937f_image_6.jpg HTTP/1.1" 201 0
2025-12-04 10:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F965b4c08-f785-42a1-a195-003fbb6a7591_11.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/965b4c08-f785-42a1-a195-003fbb6a7591_11.jpg saved to cache
2025-12-04 10:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9bd84f78-b040-546f-bd31-1f239321937f
2025-12-04 10:03:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd005010>
2025-12-04 10:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa/a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa_image_5.jpg HTTP/1.1" 201 0
2025-12-04 10:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb0e78064-bba9-4c47-8b33-8e461a1548ff_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b0e78064-bba9-4c47-8b33-8e461a1548ff_4.jpg saved to cache
2025-12-04 10:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa
2025-12-04 10:03:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cceb08d0>
2025-12-04 10:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bd84f78-b040-546f-bd31-1f239321937f/9bd84f78-b040-546f-bd31-1f239321937f_image_5.jpg HTTP/1.1" 201 0
2025-12-04 10:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F965b4c08-f785-42a1-a195-003fbb6a7591_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/965b4c08-f785-42a1-a195-003fbb6a7591_4.jpg saved to cache
2025-12-04 10:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9bd84f78-b040-546f-bd31-1f239321937f
2025-12-04 10:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3682181-3993179-43.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3682181-3993179-43.jpg not downloaded yet
2025-12-04 10:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3684907-3995158-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3684907-3995158-1004.jpg not downloaded yet
2025-12-04 10:03:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc72fe90>
2025-12-04 10:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bd84f78-b040-546f-bd31-1f239321937f/9bd84f78-b040-546f-bd31-1f239321937f_image_3.jpg HTTP/1.1" 201 0
2025-12-04 10:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F965b4c08-f785-42a1-a195-003fbb6a7591_ext_1.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/965b4c08-f785-42a1-a195-003fbb6a7591_ext_1.jpg saved to cache
2025-12-04 10:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9bd84f78-b040-546f-bd31-1f239321937f
2025-12-04 10:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3682181-3993179-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3682181-3993179-1000.jpg not downloaded yet
2025-12-04 10:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/965b4c08-f785-42a1-a195-003fbb6a7591_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003682181-01988700-002.pdf)
2025-12-04 10:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/965b4c08-f785-42a1-a195-003fbb6a7591_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003682181-01988700-002.pdf)
2025-12-04 10:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/b0e78064-bba9-4c47-8b33-8e461a1548ff_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003684907-01969138-004.pdf)
2025-12-04 10:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/b0e78064-bba9-4c47-8b33-8e461a1548ff_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003684907-01969138-004.pdf)
2025-12-04 10:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3684907-3995158-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003684907-01969138-004.pdf)
2025-12-04 10:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/965b4c08-f785-42a1-a195-003fbb6a7591_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003682181-01988700-002.pdf)
2025-12-04 10:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/b0e78064-bba9-4c47-8b33-8e461a1548ff_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003684907-01969138-004.pdf)
2025-12-04 10:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3682181-3993179-15.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003682181-01988700-002.pdf)
2025-12-04 10:03:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cced99d0>
2025-12-04 10:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bd84f78-b040-546f-bd31-1f239321937f/9bd84f78-b040-546f-bd31-1f239321937f_image_8.jpg HTTP/1.1" 201 0
2025-12-04 10:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F965b4c08-f785-42a1-a195-003fbb6a7591_9.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/965b4c08-f785-42a1-a195-003fbb6a7591_9.jpg saved to cache
2025-12-04 10:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9bd84f78-b040-546f-bd31-1f239321937f
2025-12-04 10:03:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd8b210>
2025-12-04 10:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bd84f78-b040-546f-bd31-1f239321937f/9bd84f78-b040-546f-bd31-1f239321937f_image_9.jpg HTTP/1.1" 201 0
2025-12-04 10:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F965b4c08-f785-42a1-a195-003fbb6a7591_ext_2.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/965b4c08-f785-42a1-a195-003fbb6a7591_ext_2.jpg saved to cache
2025-12-04 10:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9bd84f78-b040-546f-bd31-1f239321937f
2025-12-04 10:03:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce9cdd0>
2025-12-04 10:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 10:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa/a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa_image_10.jpg HTTP/1.1" 201 0
2025-12-04 10:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb0e78064-bba9-4c47-8b33-8e461a1548ff_ext_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b0e78064-bba9-4c47-8b33-8e461a1548ff_ext_5.jpg saved to cache
2025-12-04 10:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa
2025-12-04 10:03:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc54f990>
2025-12-04 10:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa/a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa_image_8.jpg HTTP/1.1" 201 0
2025-12-04 10:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb0e78064-bba9-4c47-8b33-8e461a1548ff_9.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b0e78064-bba9-4c47-8b33-8e461a1548ff_9.jpg saved to cache
2025-12-04 10:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa
2025-12-04 10:03:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc54f650>
2025-12-04 10:03:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa/a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa_image_14.jpg HTTP/1.1" 201 0
2025-12-04 10:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3684907-3995158-1000.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3684907-3995158-1000.jpg saved to cache
2025-12-04 10:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa
2025-12-04 10:03:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccdb4210>
2025-12-04 10:03:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bd84f78-b040-546f-bd31-1f239321937f/9bd84f78-b040-546f-bd31-1f239321937f_image_10.jpg HTTP/1.1" 201 0
2025-12-04 10:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F965b4c08-f785-42a1-a195-003fbb6a7591_ext_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/965b4c08-f785-42a1-a195-003fbb6a7591_ext_5.jpg saved to cache
2025-12-04 10:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 9bd84f78-b040-546f-bd31-1f239321937f
2025-12-04 10:03:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccfd0bd0>
2025-12-04 10:03:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa/a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa_image_9.jpg HTTP/1.1" 201 0
2025-12-04 10:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb0e78064-bba9-4c47-8b33-8e461a1548ff_ext_2.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b0e78064-bba9-4c47-8b33-8e461a1548ff_ext_2.jpg saved to cache
2025-12-04 10:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa
2025-12-04 10:03:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cccd18d0>
2025-12-04 10:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 10:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bd84f78-b040-546f-bd31-1f239321937f/9bd84f78-b040-546f-bd31-1f239321937f_image_14.jpg HTTP/1.1" 201 0
2025-12-04 10:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3682181-3993179-15.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3682181-3993179-15.jpg saved to cache
2025-12-04 10:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 9bd84f78-b040-546f-bd31-1f239321937f
2025-12-04 10:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/965b4c08-f785-42a1-a195-003fbb6a7591_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003682181-01988700-002.pdf)
2025-12-04 10:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/965b4c08-f785-42a1-a195-003fbb6a7591_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003682181-01988700-002.pdf)
2025-12-04 10:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/b0e78064-bba9-4c47-8b33-8e461a1548ff_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003684907-01969138-004.pdf)
2025-12-04 10:03:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 10:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3682181-3993179-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003682181-01988700-002.pdf)
2025-12-04 10:03:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 10:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/965b4c08-f785-42a1-a195-003fbb6a7591_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003682181-01988700-002.pdf)
2025-12-04 10:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/b0e78064-bba9-4c47-8b33-8e461a1548ff_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003684907-01969138-004.pdf)
2025-12-04 10:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/b0e78064-bba9-4c47-8b33-8e461a1548ff_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003684907-01969138-004.pdf)
2025-12-04 10:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3684907-3995158-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003684907-01969138-004.pdf)
2025-12-04 10:03:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 10:03:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 10:03:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 10:03:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 10:03:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6d2f90>
2025-12-04 10:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bd84f78-b040-546f-bd31-1f239321937f/9bd84f78-b040-546f-bd31-1f239321937f_image_7.jpg HTTP/1.1" 201 0
2025-12-04 10:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F965b4c08-f785-42a1-a195-003fbb6a7591_10.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/965b4c08-f785-42a1-a195-003fbb6a7591_10.jpg saved to cache
2025-12-04 10:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9bd84f78-b040-546f-bd31-1f239321937f
2025-12-04 10:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3682181-3993179-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003682181-01988700-002.pdf)
2025-12-04 10:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3682181-3993179-43.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003682181-01988700-002.pdf)
2025-12-04 10:03:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd81dd0>
2025-12-04 10:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bd84f78-b040-546f-bd31-1f239321937f/9bd84f78-b040-546f-bd31-1f239321937f_image_11.jpg HTTP/1.1" 201 0
2025-12-04 10:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F965b4c08-f785-42a1-a195-003fbb6a7591_ext_3.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/965b4c08-f785-42a1-a195-003fbb6a7591_ext_3.jpg saved to cache
2025-12-04 10:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 9bd84f78-b040-546f-bd31-1f239321937f
2025-12-04 10:03:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccc9d490>
2025-12-04 10:03:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa/a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa_image_12.jpg HTTP/1.1" 201 0
2025-12-04 10:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb0e78064-bba9-4c47-8b33-8e461a1548ff_ext_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b0e78064-bba9-4c47-8b33-8e461a1548ff_ext_4.jpg saved to cache
2025-12-04 10:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa
2025-12-04 10:03:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd090fd0>
2025-12-04 10:03:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bd84f78-b040-546f-bd31-1f239321937f/9bd84f78-b040-546f-bd31-1f239321937f_image_13.jpg HTTP/1.1" 201 0
2025-12-04 10:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3682181-3993179-13.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3682181-3993179-13.jpg saved to cache
2025-12-04 10:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 9bd84f78-b040-546f-bd31-1f239321937f
2025-12-04 10:03:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccdd0210>
2025-12-04 10:03:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bd84f78-b040-546f-bd31-1f239321937f/9bd84f78-b040-546f-bd31-1f239321937f_image_12.jpg HTTP/1.1" 201 0
2025-12-04 10:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F965b4c08-f785-42a1-a195-003fbb6a7591_ext_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/965b4c08-f785-42a1-a195-003fbb6a7591_ext_4.jpg saved to cache
2025-12-04 10:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 9bd84f78-b040-546f-bd31-1f239321937f
2025-12-04 10:03:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf91450>
2025-12-04 10:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa/a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa_image_11.jpg HTTP/1.1" 201 0
2025-12-04 10:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb0e78064-bba9-4c47-8b33-8e461a1548ff_ext_3.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b0e78064-bba9-4c47-8b33-8e461a1548ff_ext_3.jpg saved to cache
2025-12-04 10:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa
2025-12-04 10:03:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc719c10>
2025-12-04 10:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:03:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa/a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa_image_7.jpg HTTP/1.1" 201 0
2025-12-04 10:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb0e78064-bba9-4c47-8b33-8e461a1548ff_10.jpg') HTTP/1.1" 204 0
2025-12-04 10:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b0e78064-bba9-4c47-8b33-8e461a1548ff_10.jpg saved to cache
2025-12-04 10:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa
2025-12-04 10:03:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:03:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6cd2d0>
2025-12-04 10:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:04:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa/a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa_image_13.jpg HTTP/1.1" 201 0
2025-12-04 10:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3684907-3995158-13.jpg') HTTP/1.1" 204 0
2025-12-04 10:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3684907-3995158-13.jpg saved to cache
2025-12-04 10:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa
2025-12-04 10:04:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 10:04:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 10:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3682181-3993179-42.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003682181-01988700-002.pdf)
2025-12-04 10:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3682181-3993179-28.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003682181-01988700-002.pdf)
2025-12-04 10:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3684907-3995158-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003684907-01969138-004.pdf)
2025-12-04 10:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3684907-3995158-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003684907-01969138-004.pdf)
2025-12-04 10:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3684907-3995158-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003684907-01969138-004.pdf)
2025-12-04 10:04:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:04:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:04:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:04:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd2fdd0>
2025-12-04 10:04:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:04:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bd84f78-b040-546f-bd31-1f239321937f/9bd84f78-b040-546f-bd31-1f239321937f_image_19.jpg HTTP/1.1" 201 0
2025-12-04 10:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3682181-3993179-1000.jpg') HTTP/1.1" 204 0
2025-12-04 10:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3682181-3993179-1000.jpg saved to cache
2025-12-04 10:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 9bd84f78-b040-546f-bd31-1f239321937f
2025-12-04 10:04:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:04:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:04:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:04:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccfc1d10>
2025-12-04 10:04:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:04:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bd84f78-b040-546f-bd31-1f239321937f/9bd84f78-b040-546f-bd31-1f239321937f_image_18.jpg HTTP/1.1" 201 0
2025-12-04 10:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3682181-3993179-43.jpg') HTTP/1.1" 204 0
2025-12-04 10:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3682181-3993179-43.jpg saved to cache
2025-12-04 10:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 9bd84f78-b040-546f-bd31-1f239321937f
2025-12-04 10:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3684907-3995158-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003684907-01969138-004.pdf)
2025-12-04 10:04:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:04:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:04:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:04:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc58cb90>
2025-12-04 10:04:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:04:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:04:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bd84f78-b040-546f-bd31-1f239321937f/9bd84f78-b040-546f-bd31-1f239321937f_image_17.jpg HTTP/1.1" 201 0
2025-12-04 10:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3682181-3993179-42.jpg') HTTP/1.1" 204 0
2025-12-04 10:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3682181-3993179-42.jpg saved to cache
2025-12-04 10:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 9bd84f78-b040-546f-bd31-1f239321937f
2025-12-04 10:04:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:04:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:04:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:04:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd02bad0>
2025-12-04 10:04:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:04:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:04:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bd84f78-b040-546f-bd31-1f239321937f/9bd84f78-b040-546f-bd31-1f239321937f_image_16.jpg HTTP/1.1" 201 0
2025-12-04 10:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3682181-3993179-28.jpg') HTTP/1.1" 204 0
2025-12-04 10:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3682181-3993179-28.jpg saved to cache
2025-12-04 10:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 9bd84f78-b040-546f-bd31-1f239321937f
2025-12-04 10:04:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:04:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:04:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:04:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6c7150>
2025-12-04 10:04:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:04:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:04:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa/a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa_image_17.jpg HTTP/1.1" 201 0
2025-12-04 10:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3684907-3995158-1003.jpg') HTTP/1.1" 204 0
2025-12-04 10:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3684907-3995158-1003.jpg saved to cache
2025-12-04 10:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa
2025-12-04 10:04:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:04:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:04:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:04:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccca5810>
2025-12-04 10:04:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:04:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:04:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa/a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa_image_18.jpg HTTP/1.1" 201 0
2025-12-04 10:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3684907-3995158-1004.jpg') HTTP/1.1" 204 0
2025-12-04 10:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3684907-3995158-1004.jpg saved to cache
2025-12-04 10:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa
2025-12-04 10:04:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:04:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:04:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:04:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccca4310>
2025-12-04 10:04:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:04:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:04:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa/a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa_image_16.jpg HTTP/1.1" 201 0
2025-12-04 10:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3684907-3995158-1002.jpg') HTTP/1.1" 204 0
2025-12-04 10:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3684907-3995158-1002.jpg saved to cache
2025-12-04 10:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa
2025-12-04 10:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3682181-3993179-16.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003682181-01988700-002.pdf)
2025-12-04 10:04:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:04:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:04:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:04:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce2f210>
2025-12-04 10:04:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:04:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:04:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa/a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa_image_15.jpg HTTP/1.1" 201 0
2025-12-04 10:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3684907-3995158-1001.jpg') HTTP/1.1" 204 0
2025-12-04 10:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3684907-3995158-1001.jpg saved to cache
2025-12-04 10:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa
2025-12-04 10:04:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa, skipping ID generation
2025-12-04 10:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa from tracking dictionaries
2025-12-04 10:04:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa sending to next pipeline
2025-12-04 10:04:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa, identifier: 3684907
2025-12-04 10:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3367434-4001907-1.jpg> (referer: None)
2025-12-04 10:04:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa with identifier: 3684907
2025-12-04 10:04:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa with identifier: 3684907
2025-12-04 10:04:03 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa with identifier: 3684907 to the API
2025-12-04 10:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 10:04:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 10:04:04 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/insp-0001-3684907-3995158-1001.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa/a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa_expert_report_file_268333e1-5d2f-4694-8064-fe3d09300836.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003684907-01969138-004.pdf',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': '2025-12-05T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'BT73JCU',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/CITROEN/C3?id=3684907',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'CITROEN',
 'model': 'C3',
 'odometer': 11553,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa/a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 231128,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b0e78064-bba9-4c47-8b33-8e461a1548ff_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa/a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 231128,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b0e78064-bba9-4c47-8b33-8e461a1548ff_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa/a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 261007,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b0e78064-bba9-4c47-8b33-8e461a1548ff_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa/a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 185296,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b0e78064-bba9-4c47-8b33-8e461a1548ff_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa/a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 189442,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b0e78064-bba9-4c47-8b33-8e461a1548ff_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa/a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 191547,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b0e78064-bba9-4c47-8b33-8e461a1548ff_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa/a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 188055,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b0e78064-bba9-4c47-8b33-8e461a1548ff_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa/a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 194299,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b0e78064-bba9-4c47-8b33-8e461a1548ff_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa/a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 209086,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b0e78064-bba9-4c47-8b33-8e461a1548ff_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa/a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 271101,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b0e78064-bba9-4c47-8b33-8e461a1548ff_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa/a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 217048,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b0e78064-bba9-4c47-8b33-8e461a1548ff_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa/a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 239319,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b0e78064-bba9-4c47-8b33-8e461a1548ff_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa/a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 226103,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b0e78064-bba9-4c47-8b33-8e461a1548ff_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa/a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 413073,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3684907-3995158-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa/a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 216924,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3684907-3995158-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa/a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 273705,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3684907-3995158-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa/a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 297640,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3684907-3995158-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa/a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 383336,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3684907-3995158-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa/a68d82ed-6ef7-5f15-bce9-41b2c45c4aaa_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 419277,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3684907-3995158-1004.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-10-31',
 'seller_name': 'Leasys',
 'title': 'CITROEN C3 1.2 PureTech 110 C-Series Edition 5dr EAT6',
 'transmission': 'automatic',
 'trim': '1.2 PureTech 110 C-Series Edition 5dr EAT6',
 'year': 2023}
2025-12-04 10:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273684907%27 HTTP/1.1" 200 None
2025-12-04 10:04:04 [manheim.gb] INFO: Saving data for 3684907: {'created_time': 1764842644.186623, 'last_price_update_time': 1764842644.186636, 'auction_closing_time': 1764925200.0}
2025-12-04 10:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3684907') HTTP/1.1" 204 0
2025-12-04 10:04:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:04:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:04:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:04:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ce7079d0>
2025-12-04 10:04:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:04:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:04:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bd84f78-b040-546f-bd31-1f239321937f/9bd84f78-b040-546f-bd31-1f239321937f_image_15.jpg HTTP/1.1" 201 0
2025-12-04 10:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3682181-3993179-16.jpg') HTTP/1.1" 204 0
2025-12-04 10:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3682181-3993179-16.jpg saved to cache
2025-12-04 10:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 9bd84f78-b040-546f-bd31-1f239321937f
2025-12-04 10:04:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9bd84f78-b040-546f-bd31-1f239321937f, skipping ID generation
2025-12-04 10:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 9bd84f78-b040-546f-bd31-1f239321937f from tracking dictionaries
2025-12-04 10:04:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9bd84f78-b040-546f-bd31-1f239321937f sending to next pipeline
2025-12-04 10:04:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 9bd84f78-b040-546f-bd31-1f239321937f, identifier: 3682181
2025-12-04 10:04:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 9bd84f78-b040-546f-bd31-1f239321937f with identifier: 3682181
2025-12-04 10:04:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 9bd84f78-b040-546f-bd31-1f239321937f with identifier: 3682181
2025-12-04 10:04:04 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 9bd84f78-b040-546f-bd31-1f239321937f with identifier: 3682181 to the API
2025-12-04 10:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 10:04:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 10:04:04 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/insp-0001-3682181-3993179-16.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 145,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bd84f78-b040-546f-bd31-1f239321937f/9bd84f78-b040-546f-bd31-1f239321937f_expert_report_file_aa55fa80-9f9f-48ca-a624-40d0bfd388d2.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003682181-01988700-002.pdf',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '1.3L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '9bd84f78-b040-546f-bd31-1f239321937f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'YA70VHX',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=3682181',
 'listing': 'auction',
 'location': 'Leeds',
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 42252,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 31,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bd84f78-b040-546f-bd31-1f239321937f/9bd84f78-b040-546f-bd31-1f239321937f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 191344,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/965b4c08-f785-42a1-a195-003fbb6a7591_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bd84f78-b040-546f-bd31-1f239321937f/9bd84f78-b040-546f-bd31-1f239321937f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 191344,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/965b4c08-f785-42a1-a195-003fbb6a7591_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bd84f78-b040-546f-bd31-1f239321937f/9bd84f78-b040-546f-bd31-1f239321937f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 238208,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/965b4c08-f785-42a1-a195-003fbb6a7591_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bd84f78-b040-546f-bd31-1f239321937f/9bd84f78-b040-546f-bd31-1f239321937f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 201980,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/965b4c08-f785-42a1-a195-003fbb6a7591_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bd84f78-b040-546f-bd31-1f239321937f/9bd84f78-b040-546f-bd31-1f239321937f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 184893,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/965b4c08-f785-42a1-a195-003fbb6a7591_5.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bd84f78-b040-546f-bd31-1f239321937f/9bd84f78-b040-546f-bd31-1f239321937f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 190592,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/965b4c08-f785-42a1-a195-003fbb6a7591_4.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bd84f78-b040-546f-bd31-1f239321937f/9bd84f78-b040-546f-bd31-1f239321937f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 177581,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/965b4c08-f785-42a1-a195-003fbb6a7591_11.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bd84f78-b040-546f-bd31-1f239321937f/9bd84f78-b040-546f-bd31-1f239321937f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 190986,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/965b4c08-f785-42a1-a195-003fbb6a7591_10.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bd84f78-b040-546f-bd31-1f239321937f/9bd84f78-b040-546f-bd31-1f239321937f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 213498,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/965b4c08-f785-42a1-a195-003fbb6a7591_9.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bd84f78-b040-546f-bd31-1f239321937f/9bd84f78-b040-546f-bd31-1f239321937f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 261501,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/965b4c08-f785-42a1-a195-003fbb6a7591_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bd84f78-b040-546f-bd31-1f239321937f/9bd84f78-b040-546f-bd31-1f239321937f_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 269721,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/965b4c08-f785-42a1-a195-003fbb6a7591_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bd84f78-b040-546f-bd31-1f239321937f/9bd84f78-b040-546f-bd31-1f239321937f_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 258483,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/965b4c08-f785-42a1-a195-003fbb6a7591_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bd84f78-b040-546f-bd31-1f239321937f/9bd84f78-b040-546f-bd31-1f239321937f_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 293266,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/965b4c08-f785-42a1-a195-003fbb6a7591_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bd84f78-b040-546f-bd31-1f239321937f/9bd84f78-b040-546f-bd31-1f239321937f_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 315662,
             'Height': 843,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3682181-3993179-13.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bd84f78-b040-546f-bd31-1f239321937f/9bd84f78-b040-546f-bd31-1f239321937f_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 286205,
             'Height': 843,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3682181-3993179-15.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bd84f78-b040-546f-bd31-1f239321937f/9bd84f78-b040-546f-bd31-1f239321937f_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 304919,
             'Height': 843,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3682181-3993179-16.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bd84f78-b040-546f-bd31-1f239321937f/9bd84f78-b040-546f-bd31-1f239321937f_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 367539,
             'Height': 843,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3682181-3993179-28.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bd84f78-b040-546f-bd31-1f239321937f/9bd84f78-b040-546f-bd31-1f239321937f_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 224967,
             'Height': 843,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3682181-3993179-42.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bd84f78-b040-546f-bd31-1f239321937f/9bd84f78-b040-546f-bd31-1f239321937f_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 260044,
             'Height': 843,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3682181-3993179-43.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bd84f78-b040-546f-bd31-1f239321937f/9bd84f78-b040-546f-bd31-1f239321937f_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 211773,
             'Height': 843,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3682181-3993179-1000.jpg',
             'Width': 1500}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-25',
 'seller_name': 'Mobilize Financial Services',
 'title': 'NISSAN QASHQAI 1.3 DiG-T N-Connecta 5dr [Glass Roof Pack]',
 'transmission': 'manual',
 'trim': '1.3 DiG-T N-Connecta 5dr [Glass Roof Pack]',
 'year': 2021}
2025-12-04 10:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273682181%27 HTTP/1.1" 200 None
2025-12-04 10:04:05 [manheim.gb] INFO: Saving data for 3682181: {'created_time': 1764842645.016176, 'last_price_update_time': 1764842645.016185, 'auction_closing_time': 1765184400.0}
2025-12-04 10:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3682181') HTTP/1.1" 204 0
2025-12-04 10:04:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:04:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:04:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:04:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ce383150>
2025-12-04 10:04:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:04:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:04:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4852c08-cf28-561f-aac7-d251292092ad/f4852c08-cf28-561f-aac7-d251292092ad_image_0.jpg HTTP/1.1" 201 0
2025-12-04 10:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3367434-4001907-1.jpg') HTTP/1.1" 204 0
2025-12-04 10:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3367434-4001907-1.jpg saved to cache
2025-12-04 10:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f4852c08-cf28-561f-aac7-d251292092ad
2025-12-04 10:04:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f4852c08-cf28-561f-aac7-d251292092ad, skipping ID generation
2025-12-04 10:04:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4852c08-cf28-561f-aac7-d251292092ad with scrape type 1
2025-12-04 10:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Removing item f4852c08-cf28-561f-aac7-d251292092ad from tracking dictionaries
2025-12-04 10:04:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f4852c08-cf28-561f-aac7-d251292092ad sending to next pipeline
2025-12-04 10:04:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: f4852c08-cf28-561f-aac7-d251292092ad, identifier: 3367434
2025-12-04 10:04:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: f4852c08-cf28-561f-aac7-d251292092ad with identifier: 3367434
2025-12-04 10:04:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: f4852c08-cf28-561f-aac7-d251292092ad with identifier: 3367434
2025-12-04 10:04:05 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: f4852c08-cf28-561f-aac7-d251292092ad with identifier: 3367434 to the API
2025-12-04 10:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 10:04:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 10:04:05 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/insp-0001-3367434-4001907-1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 163,
 'car_expert_report_source_url': None,
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '1.3L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'f4852c08-cf28-561f-aac7-d251292092ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'WR70TFF',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/GOLF?id=3367434',
 'listing': 'auction',
 'location': 'Bristol',
 'make': 'MERCEDES-BENZ',
 'model': 'GOLF',
 'odometer': 21764,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 18,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4852c08-cf28-561f-aac7-d251292092ad/f4852c08-cf28-561f-aac7-d251292092ad_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 483678,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3367434-4001907-1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4852c08-cf28-561f-aac7-d251292092ad/f4852c08-cf28-561f-aac7-d251292092ad_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 275692,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3367434-4001907-2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4852c08-cf28-561f-aac7-d251292092ad/f4852c08-cf28-561f-aac7-d251292092ad_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 240502,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3367434-4001907-3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4852c08-cf28-561f-aac7-d251292092ad/f4852c08-cf28-561f-aac7-d251292092ad_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 494839,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3367434-4001907-4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4852c08-cf28-561f-aac7-d251292092ad/f4852c08-cf28-561f-aac7-d251292092ad_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 500674,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3367434-4001907-6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4852c08-cf28-561f-aac7-d251292092ad/f4852c08-cf28-561f-aac7-d251292092ad_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 388259,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3367434-4001907-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4852c08-cf28-561f-aac7-d251292092ad/f4852c08-cf28-561f-aac7-d251292092ad_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 509756,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3367434-4001907-8.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4852c08-cf28-561f-aac7-d251292092ad/f4852c08-cf28-561f-aac7-d251292092ad_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 294572,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3367434-4001907-15.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4852c08-cf28-561f-aac7-d251292092ad/f4852c08-cf28-561f-aac7-d251292092ad_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 293282,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3367434-4001907-16.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4852c08-cf28-561f-aac7-d251292092ad/f4852c08-cf28-561f-aac7-d251292092ad_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 425875,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3367434-4001907-28.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4852c08-cf28-561f-aac7-d251292092ad/f4852c08-cf28-561f-aac7-d251292092ad_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 216402,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3367434-4001907-42.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4852c08-cf28-561f-aac7-d251292092ad/f4852c08-cf28-561f-aac7-d251292092ad_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 214171,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3367434-4001907-43.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4852c08-cf28-561f-aac7-d251292092ad/f4852c08-cf28-561f-aac7-d251292092ad_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 366348,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3367434-4001907-44.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4852c08-cf28-561f-aac7-d251292092ad/f4852c08-cf28-561f-aac7-d251292092ad_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 253166,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3367434-4001907-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4852c08-cf28-561f-aac7-d251292092ad/f4852c08-cf28-561f-aac7-d251292092ad_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 203374,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3367434-4001907-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4852c08-cf28-561f-aac7-d251292092ad/f4852c08-cf28-561f-aac7-d251292092ad_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 151897,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3367434-4001907-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4852c08-cf28-561f-aac7-d251292092ad/f4852c08-cf28-561f-aac7-d251292092ad_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 231185,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3367434-4001907-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4852c08-cf28-561f-aac7-d251292092ad/f4852c08-cf28-561f-aac7-d251292092ad_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 209910,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3367434-4001907-1004.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-10',
 'seller_name': 'Novuna Vehicle Solutions',
 'title': 'MERCEDES-BENZ GOLF GLB 200 AMG Line 5dr 7G-Tronic',
 'transmission': 'automatic',
 'trim': 'GLB 200 AMG Line 5dr 7G-Tronic',
 'year': 2020}
2025-12-04 10:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273367434%27 HTTP/1.1" 200 None
2025-12-04 10:04:05 [manheim.gb] INFO: Saving data for 3367434: {'created_time': 1764842645.916159, 'last_price_update_time': 1764842645.916174, 'auction_closing_time': 1765270800.0}
2025-12-04 10:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3367434') HTTP/1.1" 204 0
2025-12-04 10:04:25 [scrapy.extensions.logstats] INFO: Crawled 62 pages (at -2 pages/min), scraped 10 items (at 7 items/min)
2025-12-04 10:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/KIA/SORENTO?id=3752427&returnUrl=%2Fsearch%3FPage%3D4%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233752427&indx=370> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 10:04:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 10:04:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ddc44873-e22a-5937-8216-2795f72f5cc4 with identifier: 3752427
2025-12-04 10:04:27 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item ddc44873-e22a-5937-8216-2795f72f5cc4
2025-12-04 10:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/KIA/SORENTO?id=3752426&returnUrl=%2Fsearch%3FPage%3D4%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233752426&indx=369> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 10:04:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 10:04:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07a43b40-c094-5b22-b61d-8f11e55e71c0 with identifier: 3752426
2025-12-04 10:04:30 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 07a43b40-c094-5b22-b61d-8f11e55e71c0
2025-12-04 10:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003752427-01964004-003.pdf> (referer: None)
2025-12-04 10:04:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:04:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:04:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:04:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf81010>
2025-12-04 10:04:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:04:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 10:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:04:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddc44873-e22a-5937-8216-2795f72f5cc4/ddc44873-e22a-5937-8216-2795f72f5cc4_expert_report_file_f234810a-05b2-4e24-b7dc-108f532756f9.pdf HTTP/1.1" 201 0
2025-12-04 10:04:31 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item ddc44873-e22a-5937-8216-2795f72f5cc4
2025-12-04 10:04:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ddc44873-e22a-5937-8216-2795f72f5cc4, skipping ID generation
2025-12-04 10:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item ddc44873-e22a-5937-8216-2795f72f5cc4
2025-12-04 10:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5edcd920-3030-480a-a8a3-6b6ac6bd624f_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5edcd920-3030-480a-a8a3-6b6ac6bd624f_ext_7.jpg already downloaded
2025-12-04 10:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5edcd920-3030-480a-a8a3-6b6ac6bd624f_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5edcd920-3030-480a-a8a3-6b6ac6bd624f_ext_7.jpg already downloaded
2025-12-04 10:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5edcd920-3030-480a-a8a3-6b6ac6bd624f_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5edcd920-3030-480a-a8a3-6b6ac6bd624f_ext_6.jpg already downloaded
2025-12-04 10:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5edcd920-3030-480a-a8a3-6b6ac6bd624f_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5edcd920-3030-480a-a8a3-6b6ac6bd624f_ext_1.jpg already downloaded
2025-12-04 10:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5edcd920-3030-480a-a8a3-6b6ac6bd624f_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5edcd920-3030-480a-a8a3-6b6ac6bd624f_5.jpg already downloaded
2025-12-04 10:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5edcd920-3030-480a-a8a3-6b6ac6bd624f_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5edcd920-3030-480a-a8a3-6b6ac6bd624f_4.jpg already downloaded
2025-12-04 10:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5edcd920-3030-480a-a8a3-6b6ac6bd624f_11.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5edcd920-3030-480a-a8a3-6b6ac6bd624f_11.jpg already downloaded
2025-12-04 10:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5edcd920-3030-480a-a8a3-6b6ac6bd624f_10.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5edcd920-3030-480a-a8a3-6b6ac6bd624f_10.jpg already downloaded
2025-12-04 10:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5edcd920-3030-480a-a8a3-6b6ac6bd624f_9.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5edcd920-3030-480a-a8a3-6b6ac6bd624f_9.jpg already downloaded
2025-12-04 10:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5edcd920-3030-480a-a8a3-6b6ac6bd624f_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5edcd920-3030-480a-a8a3-6b6ac6bd624f_ext_2.jpg already downloaded
2025-12-04 10:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5edcd920-3030-480a-a8a3-6b6ac6bd624f_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5edcd920-3030-480a-a8a3-6b6ac6bd624f_ext_5.jpg already downloaded
2025-12-04 10:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5edcd920-3030-480a-a8a3-6b6ac6bd624f_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5edcd920-3030-480a-a8a3-6b6ac6bd624f_ext_3.jpg already downloaded
2025-12-04 10:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5edcd920-3030-480a-a8a3-6b6ac6bd624f_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5edcd920-3030-480a-a8a3-6b6ac6bd624f_ext_4.jpg already downloaded
2025-12-04 10:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3752427-3973875-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3752427-3973875-13.jpg already downloaded
2025-12-04 10:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3752427-3973875-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3752427-3973875-1000.jpg already downloaded
2025-12-04 10:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3752427-3973875-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3752427-3973875-1001.jpg already downloaded
2025-12-04 10:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3752427-3973875-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3752427-3973875-1002.jpg already downloaded
2025-12-04 10:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3752427-3973875-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3752427-3973875-1003.jpg already downloaded
2025-12-04 10:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3752427-3973875-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3752427-3973875-1004.jpg already downloaded
2025-12-04 10:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3752427-3973875-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3752427-3973875-1005.jpg already downloaded
2025-12-04 10:04:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: ddc44873-e22a-5937-8216-2795f72f5cc4, identifier: 3752427
2025-12-04 10:04:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: ddc44873-e22a-5937-8216-2795f72f5cc4 with identifier: 3752427
2025-12-04 10:04:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: ddc44873-e22a-5937-8216-2795f72f5cc4 with identifier: 3752427
2025-12-04 10:04:31 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: ddc44873-e22a-5937-8216-2795f72f5cc4 with identifier: 3752427 to the API
2025-12-04 10:04:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 10:04:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 10:04:31 [scrapy.core.scraper] DEBUG: Scraped from <200 http://ecr.manheim.co.uk/pdf/MOL-0003752427-01964004-003.pdf>
{'auction_title': '',
 'c_o_2_emission_value': 158,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddc44873-e22a-5937-8216-2795f72f5cc4/ddc44873-e22a-5937-8216-2795f72f5cc4_expert_report_file_f234810a-05b2-4e24-b7dc-108f532756f9.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003752427-01964004-003.pdf',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': '2025-12-05T09:00:00Z',
 'fuel_type': 'Petrol/Hybrid',
 'id': 'ddc44873-e22a-5937-8216-2795f72f5cc4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'MM22NJX',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/KIA/SORENTO?id=3752427',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'KIA',
 'model': 'SORENTO',
 'odometer': 21897,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 38,
 'photo_urls': ['http://images.manheim.co.uk/images/units/zoom/5edcd920-3030-480a-a8a3-6b6ac6bd624f_ext_7.jpg',
                'http://images.manheim.co.uk/images/units/zoom/5edcd920-3030-480a-a8a3-6b6ac6bd624f_ext_7.jpg',
                'http://images.manheim.co.uk/images/units/zoom/5edcd920-3030-480a-a8a3-6b6ac6bd624f_ext_6.jpg',
                'http://images.manheim.co.uk/images/units/zoom/5edcd920-3030-480a-a8a3-6b6ac6bd624f_ext_1.jpg',
                'http://images.manheim.co.uk/images/units/zoom/5edcd920-3030-480a-a8a3-6b6ac6bd624f_5.jpg',
                'http://images.manheim.co.uk/images/units/zoom/5edcd920-3030-480a-a8a3-6b6ac6bd624f_4.jpg',
                'http://images.manheim.co.uk/images/units/zoom/5edcd920-3030-480a-a8a3-6b6ac6bd624f_11.jpg',
                'http://images.manheim.co.uk/images/units/zoom/5edcd920-3030-480a-a8a3-6b6ac6bd624f_10.jpg',
                'http://images.manheim.co.uk/images/units/zoom/5edcd920-3030-480a-a8a3-6b6ac6bd624f_9.jpg',
                'http://images.manheim.co.uk/images/units/zoom/5edcd920-3030-480a-a8a3-6b6ac6bd624f_ext_2.jpg',
                'http://images.manheim.co.uk/images/units/zoom/5edcd920-3030-480a-a8a3-6b6ac6bd624f_ext_5.jpg',
                'http://images.manheim.co.uk/images/units/zoom/5edcd920-3030-480a-a8a3-6b6ac6bd624f_ext_3.jpg',
                'http://images.manheim.co.uk/images/units/zoom/5edcd920-3030-480a-a8a3-6b6ac6bd624f_ext_4.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3752427-3973875-13.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3752427-3973875-1000.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3752427-3973875-1001.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3752427-3973875-1002.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3752427-3973875-1003.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3752427-3973875-1004.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3752427-3973875-1005.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddc44873-e22a-5937-8216-2795f72f5cc4/ddc44873-e22a-5937-8216-2795f72f5cc4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 214443,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5edcd920-3030-480a-a8a3-6b6ac6bd624f_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddc44873-e22a-5937-8216-2795f72f5cc4/ddc44873-e22a-5937-8216-2795f72f5cc4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 214443,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5edcd920-3030-480a-a8a3-6b6ac6bd624f_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddc44873-e22a-5937-8216-2795f72f5cc4/ddc44873-e22a-5937-8216-2795f72f5cc4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 306071,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5edcd920-3030-480a-a8a3-6b6ac6bd624f_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddc44873-e22a-5937-8216-2795f72f5cc4/ddc44873-e22a-5937-8216-2795f72f5cc4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 137307,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5edcd920-3030-480a-a8a3-6b6ac6bd624f_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddc44873-e22a-5937-8216-2795f72f5cc4/ddc44873-e22a-5937-8216-2795f72f5cc4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 422452,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3752427-3973875-13.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddc44873-e22a-5937-8216-2795f72f5cc4/ddc44873-e22a-5937-8216-2795f72f5cc4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 219979,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5edcd920-3030-480a-a8a3-6b6ac6bd624f_5.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddc44873-e22a-5937-8216-2795f72f5cc4/ddc44873-e22a-5937-8216-2795f72f5cc4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 275939,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3752427-3973875-1000.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddc44873-e22a-5937-8216-2795f72f5cc4/ddc44873-e22a-5937-8216-2795f72f5cc4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 209836,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5edcd920-3030-480a-a8a3-6b6ac6bd624f_4.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddc44873-e22a-5937-8216-2795f72f5cc4/ddc44873-e22a-5937-8216-2795f72f5cc4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 427793,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3752427-3973875-1001.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddc44873-e22a-5937-8216-2795f72f5cc4/ddc44873-e22a-5937-8216-2795f72f5cc4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 204643,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5edcd920-3030-480a-a8a3-6b6ac6bd624f_11.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddc44873-e22a-5937-8216-2795f72f5cc4/ddc44873-e22a-5937-8216-2795f72f5cc4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 253956,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3752427-3973875-1002.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddc44873-e22a-5937-8216-2795f72f5cc4/ddc44873-e22a-5937-8216-2795f72f5cc4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 211730,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5edcd920-3030-480a-a8a3-6b6ac6bd624f_10.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddc44873-e22a-5937-8216-2795f72f5cc4/ddc44873-e22a-5937-8216-2795f72f5cc4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 211540,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3752427-3973875-1003.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddc44873-e22a-5937-8216-2795f72f5cc4/ddc44873-e22a-5937-8216-2795f72f5cc4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 200843,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5edcd920-3030-480a-a8a3-6b6ac6bd624f_9.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddc44873-e22a-5937-8216-2795f72f5cc4/ddc44873-e22a-5937-8216-2795f72f5cc4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 286258,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3752427-3973875-1004.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddc44873-e22a-5937-8216-2795f72f5cc4/ddc44873-e22a-5937-8216-2795f72f5cc4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 252254,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5edcd920-3030-480a-a8a3-6b6ac6bd624f_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddc44873-e22a-5937-8216-2795f72f5cc4/ddc44873-e22a-5937-8216-2795f72f5cc4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 386505,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3752427-3973875-1005.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddc44873-e22a-5937-8216-2795f72f5cc4/ddc44873-e22a-5937-8216-2795f72f5cc4_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 228400,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5edcd920-3030-480a-a8a3-6b6ac6bd624f_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddc44873-e22a-5937-8216-2795f72f5cc4/ddc44873-e22a-5937-8216-2795f72f5cc4_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 219366,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5edcd920-3030-480a-a8a3-6b6ac6bd624f_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddc44873-e22a-5937-8216-2795f72f5cc4/ddc44873-e22a-5937-8216-2795f72f5cc4_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 236246,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5edcd920-3030-480a-a8a3-6b6ac6bd624f_ext_4.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-04',
 'seller_name': 'Leasys',
 'title': 'KIA SORENTO 1.6 T-GDi HEV 2 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.6 T-GDi HEV 2 5dr Auto',
 'year': 2022}
2025-12-04 10:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273752427%27 HTTP/1.1" 200 None
2025-12-04 10:04:31 [manheim.gb] INFO: Saving data for 3752427: {'created_time': 1764842671.961748, 'last_price_update_time': 1764842671.961759, 'auction_closing_time': 1764925200.0}
2025-12-04 10:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3752427') HTTP/1.1" 204 0
2025-12-04 10:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/KIA/SPORTAGE?id=3753028&returnUrl=%2Fsearch%3FPage%3D4%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233753028&indx=372> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 10:04:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 10:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003752426-01969136-004.pdf> (referer: None)
2025-12-04 10:04:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 672a8c4f-71d8-58f3-8299-077e7dbd1660 with identifier: 3753028
2025-12-04 10:04:32 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 672a8c4f-71d8-58f3-8299-077e7dbd1660
2025-12-04 10:04:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:04:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce65090>
2025-12-04 10:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:04:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:04:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:04:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07a43b40-c094-5b22-b61d-8f11e55e71c0/07a43b40-c094-5b22-b61d-8f11e55e71c0_expert_report_file_dce18227-575a-4c07-9c51-03b7552502b9.pdf HTTP/1.1" 201 0
2025-12-04 10:04:32 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 07a43b40-c094-5b22-b61d-8f11e55e71c0
2025-12-04 10:04:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 07a43b40-c094-5b22-b61d-8f11e55e71c0, skipping ID generation
2025-12-04 10:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 07a43b40-c094-5b22-b61d-8f11e55e71c0
2025-12-04 10:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdbdb3c14-3fe2-450a-98a7-33597d0542ed_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dbdb3c14-3fe2-450a-98a7-33597d0542ed_ext_7.jpg not downloaded yet
2025-12-04 10:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdbdb3c14-3fe2-450a-98a7-33597d0542ed_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dbdb3c14-3fe2-450a-98a7-33597d0542ed_ext_7.jpg not downloaded yet
2025-12-04 10:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdbdb3c14-3fe2-450a-98a7-33597d0542ed_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dbdb3c14-3fe2-450a-98a7-33597d0542ed_ext_6.jpg not downloaded yet
2025-12-04 10:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdbdb3c14-3fe2-450a-98a7-33597d0542ed_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dbdb3c14-3fe2-450a-98a7-33597d0542ed_ext_1.jpg not downloaded yet
2025-12-04 10:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdbdb3c14-3fe2-450a-98a7-33597d0542ed_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dbdb3c14-3fe2-450a-98a7-33597d0542ed_5.jpg not downloaded yet
2025-12-04 10:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdbdb3c14-3fe2-450a-98a7-33597d0542ed_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dbdb3c14-3fe2-450a-98a7-33597d0542ed_4.jpg not downloaded yet
2025-12-04 10:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdbdb3c14-3fe2-450a-98a7-33597d0542ed_11.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dbdb3c14-3fe2-450a-98a7-33597d0542ed_11.jpg not downloaded yet
2025-12-04 10:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdbdb3c14-3fe2-450a-98a7-33597d0542ed_10.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dbdb3c14-3fe2-450a-98a7-33597d0542ed_10.jpg not downloaded yet
2025-12-04 10:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdbdb3c14-3fe2-450a-98a7-33597d0542ed_9.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dbdb3c14-3fe2-450a-98a7-33597d0542ed_9.jpg not downloaded yet
2025-12-04 10:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdbdb3c14-3fe2-450a-98a7-33597d0542ed_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dbdb3c14-3fe2-450a-98a7-33597d0542ed_ext_2.jpg not downloaded yet
2025-12-04 10:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdbdb3c14-3fe2-450a-98a7-33597d0542ed_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dbdb3c14-3fe2-450a-98a7-33597d0542ed_ext_5.jpg not downloaded yet
2025-12-04 10:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdbdb3c14-3fe2-450a-98a7-33597d0542ed_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dbdb3c14-3fe2-450a-98a7-33597d0542ed_ext_3.jpg not downloaded yet
2025-12-04 10:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdbdb3c14-3fe2-450a-98a7-33597d0542ed_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dbdb3c14-3fe2-450a-98a7-33597d0542ed_ext_4.jpg not downloaded yet
2025-12-04 10:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3752426-3988881-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3752426-3988881-13.jpg not downloaded yet
2025-12-04 10:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3752426-3988881-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3752426-3988881-1000.jpg not downloaded yet
2025-12-04 10:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3752426-3988881-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3752426-3988881-1001.jpg not downloaded yet
2025-12-04 10:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3752426-3988881-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3752426-3988881-1002.jpg not downloaded yet
2025-12-04 10:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3752426-3988881-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3752426-3988881-1003.jpg not downloaded yet
2025-12-04 10:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3752426-3988881-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3752426-3988881-1004.jpg not downloaded yet
2025-12-04 10:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3752426-3988881-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3752426-3988881-1005.jpg not downloaded yet
2025-12-04 10:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/DACIA/JOGGER?id=3761623&returnUrl=%2Fsearch%3FPage%3D4%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233761623&indx=377> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 10:04:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 10:04:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8faa8f91-b82b-50fa-ac6f-9c0c9de5447b with identifier: 3761623
2025-12-04 10:04:33 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 8faa8f91-b82b-50fa-ac6f-9c0c9de5447b
2025-12-04 10:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3752426-3988881-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003752426-01969136-004.pdf)
2025-12-04 10:04:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:04:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:04:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:04:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc805110>
2025-12-04 10:04:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:04:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:04:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07a43b40-c094-5b22-b61d-8f11e55e71c0/07a43b40-c094-5b22-b61d-8f11e55e71c0_image_19.jpg HTTP/1.1" 201 0
2025-12-04 10:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3752426-3988881-1005.jpg') HTTP/1.1" 204 0
2025-12-04 10:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3752426-3988881-1005.jpg saved to cache
2025-12-04 10:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 07a43b40-c094-5b22-b61d-8f11e55e71c0
2025-12-04 10:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003761623-01902089-004.pdf> (referer: None)
2025-12-04 10:04:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:04:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc59c910>
2025-12-04 10:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:04:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8faa8f91-b82b-50fa-ac6f-9c0c9de5447b/8faa8f91-b82b-50fa-ac6f-9c0c9de5447b_expert_report_file_aea3464b-539e-4d71-a555-e6f3104cffaf.pdf HTTP/1.1" 201 0
2025-12-04 10:04:34 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 8faa8f91-b82b-50fa-ac6f-9c0c9de5447b
2025-12-04 10:04:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8faa8f91-b82b-50fa-ac6f-9c0c9de5447b, skipping ID generation
2025-12-04 10:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 8faa8f91-b82b-50fa-ac6f-9c0c9de5447b
2025-12-04 10:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F188434a1-b466-4e6c-86d9-fb2af3a6144e_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/188434a1-b466-4e6c-86d9-fb2af3a6144e_ext_7.jpg already downloaded
2025-12-04 10:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F188434a1-b466-4e6c-86d9-fb2af3a6144e_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/188434a1-b466-4e6c-86d9-fb2af3a6144e_ext_7.jpg already downloaded
2025-12-04 10:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F188434a1-b466-4e6c-86d9-fb2af3a6144e_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/188434a1-b466-4e6c-86d9-fb2af3a6144e_ext_6.jpg already downloaded
2025-12-04 10:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F188434a1-b466-4e6c-86d9-fb2af3a6144e_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/188434a1-b466-4e6c-86d9-fb2af3a6144e_ext_1.jpg already downloaded
2025-12-04 10:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F188434a1-b466-4e6c-86d9-fb2af3a6144e_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/188434a1-b466-4e6c-86d9-fb2af3a6144e_5.jpg already downloaded
2025-12-04 10:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F188434a1-b466-4e6c-86d9-fb2af3a6144e_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/188434a1-b466-4e6c-86d9-fb2af3a6144e_4.jpg already downloaded
2025-12-04 10:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F188434a1-b466-4e6c-86d9-fb2af3a6144e_11.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/188434a1-b466-4e6c-86d9-fb2af3a6144e_11.jpg already downloaded
2025-12-04 10:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F188434a1-b466-4e6c-86d9-fb2af3a6144e_10.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/188434a1-b466-4e6c-86d9-fb2af3a6144e_10.jpg already downloaded
2025-12-04 10:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F188434a1-b466-4e6c-86d9-fb2af3a6144e_9.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/188434a1-b466-4e6c-86d9-fb2af3a6144e_9.jpg already downloaded
2025-12-04 10:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F188434a1-b466-4e6c-86d9-fb2af3a6144e_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/188434a1-b466-4e6c-86d9-fb2af3a6144e_ext_2.jpg already downloaded
2025-12-04 10:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F188434a1-b466-4e6c-86d9-fb2af3a6144e_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/188434a1-b466-4e6c-86d9-fb2af3a6144e_ext_5.jpg already downloaded
2025-12-04 10:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F188434a1-b466-4e6c-86d9-fb2af3a6144e_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/188434a1-b466-4e6c-86d9-fb2af3a6144e_ext_3.jpg already downloaded
2025-12-04 10:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F188434a1-b466-4e6c-86d9-fb2af3a6144e_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/188434a1-b466-4e6c-86d9-fb2af3a6144e_ext_4.jpg already downloaded
2025-12-04 10:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3761623-3991374-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3761623-3991374-13.jpg already downloaded
2025-12-04 10:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3761623-3991374-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3761623-3991374-1000.jpg already downloaded
2025-12-04 10:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3761623-3991374-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3761623-3991374-1001.jpg already downloaded
2025-12-04 10:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3761623-3991374-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3761623-3991374-1002.jpg already downloaded
2025-12-04 10:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3761623-3991374-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3761623-3991374-1003.jpg already downloaded
2025-12-04 10:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3761623-3991374-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3761623-3991374-1004.jpg already downloaded
2025-12-04 10:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3761623-3991374-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3761623-3991374-1005.jpg already downloaded
2025-12-04 10:04:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 8faa8f91-b82b-50fa-ac6f-9c0c9de5447b, identifier: 3761623
2025-12-04 10:04:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 8faa8f91-b82b-50fa-ac6f-9c0c9de5447b with identifier: 3761623
2025-12-04 10:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-04 10:04:35 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Grey HTTP/1.1" 200 None
2025-12-04 10:04:35 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-04 10:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-04 10:04:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 8faa8f91-b82b-50fa-ac6f-9c0c9de5447b with identifier: 3761623
2025-12-04 10:04:35 [scrapy.core.scraper] INFO: Dropped: Dropping expired listing: 8faa8f91-b82b-50fa-ac6f-9c0c9de5447b with expiration date: 2025-12-04T09:00:00Z
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8faa8f91-b82b-50fa-ac6f-9c0c9de5447b/8faa8f91-b82b-50fa-ac6f-9c0c9de5447b_expert_report_file_aea3464b-539e-4d71-a555-e6f3104cffaf.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003761623-01902089-004.pdf',
 'color': 'Grey',
 'currency': 'GBP',
 'engine': '1.0L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '8faa8f91-b82b-50fa-ac6f-9c0c9de5447b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'AU72PLF',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/DACIA/JOGGER?id=3761623',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'DACIA',
 'model': 'JOGGER',
 'odometer': 71418,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 38,
 'photo_urls': ['http://images.manheim.co.uk/images/units/zoom/188434a1-b466-4e6c-86d9-fb2af3a6144e_ext_7.jpg',
                'http://images.manheim.co.uk/images/units/zoom/188434a1-b466-4e6c-86d9-fb2af3a6144e_ext_7.jpg',
                'http://images.manheim.co.uk/images/units/zoom/188434a1-b466-4e6c-86d9-fb2af3a6144e_ext_6.jpg',
                'http://images.manheim.co.uk/images/units/zoom/188434a1-b466-4e6c-86d9-fb2af3a6144e_ext_1.jpg',
                'http://images.manheim.co.uk/images/units/zoom/188434a1-b466-4e6c-86d9-fb2af3a6144e_5.jpg',
                'http://images.manheim.co.uk/images/units/zoom/188434a1-b466-4e6c-86d9-fb2af3a6144e_4.jpg',
                'http://images.manheim.co.uk/images/units/zoom/188434a1-b466-4e6c-86d9-fb2af3a6144e_11.jpg',
                'http://images.manheim.co.uk/images/units/zoom/188434a1-b466-4e6c-86d9-fb2af3a6144e_10.jpg',
                'http://images.manheim.co.uk/images/units/zoom/188434a1-b466-4e6c-86d9-fb2af3a6144e_9.jpg',
                'http://images.manheim.co.uk/images/units/zoom/188434a1-b466-4e6c-86d9-fb2af3a6144e_ext_2.jpg',
                'http://images.manheim.co.uk/images/units/zoom/188434a1-b466-4e6c-86d9-fb2af3a6144e_ext_5.jpg',
                'http://images.manheim.co.uk/images/units/zoom/188434a1-b466-4e6c-86d9-fb2af3a6144e_ext_3.jpg',
                'http://images.manheim.co.uk/images/units/zoom/188434a1-b466-4e6c-86d9-fb2af3a6144e_ext_4.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3761623-3991374-13.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3761623-3991374-1000.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3761623-3991374-1001.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3761623-3991374-1002.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3761623-3991374-1003.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3761623-3991374-1004.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3761623-3991374-1005.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8faa8f91-b82b-50fa-ac6f-9c0c9de5447b/8faa8f91-b82b-50fa-ac6f-9c0c9de5447b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 205615,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/188434a1-b466-4e6c-86d9-fb2af3a6144e_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8faa8f91-b82b-50fa-ac6f-9c0c9de5447b/8faa8f91-b82b-50fa-ac6f-9c0c9de5447b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 205615,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/188434a1-b466-4e6c-86d9-fb2af3a6144e_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8faa8f91-b82b-50fa-ac6f-9c0c9de5447b/8faa8f91-b82b-50fa-ac6f-9c0c9de5447b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 303323,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/188434a1-b466-4e6c-86d9-fb2af3a6144e_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8faa8f91-b82b-50fa-ac6f-9c0c9de5447b/8faa8f91-b82b-50fa-ac6f-9c0c9de5447b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 164288,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/188434a1-b466-4e6c-86d9-fb2af3a6144e_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8faa8f91-b82b-50fa-ac6f-9c0c9de5447b/8faa8f91-b82b-50fa-ac6f-9c0c9de5447b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 172025,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/188434a1-b466-4e6c-86d9-fb2af3a6144e_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8faa8f91-b82b-50fa-ac6f-9c0c9de5447b/8faa8f91-b82b-50fa-ac6f-9c0c9de5447b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 187627,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/188434a1-b466-4e6c-86d9-fb2af3a6144e_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8faa8f91-b82b-50fa-ac6f-9c0c9de5447b/8faa8f91-b82b-50fa-ac6f-9c0c9de5447b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 196346,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/188434a1-b466-4e6c-86d9-fb2af3a6144e_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8faa8f91-b82b-50fa-ac6f-9c0c9de5447b/8faa8f91-b82b-50fa-ac6f-9c0c9de5447b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 157681,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/188434a1-b466-4e6c-86d9-fb2af3a6144e_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8faa8f91-b82b-50fa-ac6f-9c0c9de5447b/8faa8f91-b82b-50fa-ac6f-9c0c9de5447b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 170012,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/188434a1-b466-4e6c-86d9-fb2af3a6144e_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8faa8f91-b82b-50fa-ac6f-9c0c9de5447b/8faa8f91-b82b-50fa-ac6f-9c0c9de5447b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 302865,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/188434a1-b466-4e6c-86d9-fb2af3a6144e_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8faa8f91-b82b-50fa-ac6f-9c0c9de5447b/8faa8f91-b82b-50fa-ac6f-9c0c9de5447b_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 265490,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/188434a1-b466-4e6c-86d9-fb2af3a6144e_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8faa8f91-b82b-50fa-ac6f-9c0c9de5447b/8faa8f91-b82b-50fa-ac6f-9c0c9de5447b_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 249060,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/188434a1-b466-4e6c-86d9-fb2af3a6144e_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8faa8f91-b82b-50fa-ac6f-9c0c9de5447b/8faa8f91-b82b-50fa-ac6f-9c0c9de5447b_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 262470,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/188434a1-b466-4e6c-86d9-fb2af3a6144e_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8faa8f91-b82b-50fa-ac6f-9c0c9de5447b/8faa8f91-b82b-50fa-ac6f-9c0c9de5447b_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80428,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3761623-3991374-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8faa8f91-b82b-50fa-ac6f-9c0c9de5447b/8faa8f91-b82b-50fa-ac6f-9c0c9de5447b_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 398535,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3761623-3991374-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8faa8f91-b82b-50fa-ac6f-9c0c9de5447b/8faa8f91-b82b-50fa-ac6f-9c0c9de5447b_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 290422,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3761623-3991374-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8faa8f91-b82b-50fa-ac6f-9c0c9de5447b/8faa8f91-b82b-50fa-ac6f-9c0c9de5447b_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 300101,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3761623-3991374-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8faa8f91-b82b-50fa-ac6f-9c0c9de5447b/8faa8f91-b82b-50fa-ac6f-9c0c9de5447b_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 292306,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3761623-3991374-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8faa8f91-b82b-50fa-ac6f-9c0c9de5447b/8faa8f91-b82b-50fa-ac6f-9c0c9de5447b_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 216579,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3761623-3991374-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8faa8f91-b82b-50fa-ac6f-9c0c9de5447b/8faa8f91-b82b-50fa-ac6f-9c0c9de5447b_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 207494,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3761623-3991374-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-14',
 'seller_name': 'Lookers',
 'title': 'DACIA JOGGER 1.0 TCe Comfort 5dr',
 'transmission': 'manual',
 'trim': '1.0 TCe Comfort 5dr',
 'year': 2022}
2025-12-04 10:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273761623%27 HTTP/1.1" 200 None
2025-12-04 10:04:35 [manheim.gb] INFO: Saving data for 3761623: {'created_time': 1764842675.193408, 'last_price_update_time': 1764842675.193416, 'auction_closing_time': 1764838800.0}
2025-12-04 10:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3761623') HTTP/1.1" 204 0
2025-12-04 10:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3752426-3988881-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003752426-01969136-004.pdf)
2025-12-04 10:04:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:04:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5bfbd0>
2025-12-04 10:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:04:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07a43b40-c094-5b22-b61d-8f11e55e71c0/07a43b40-c094-5b22-b61d-8f11e55e71c0_image_18.jpg HTTP/1.1" 201 0
2025-12-04 10:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3752426-3988881-1004.jpg') HTTP/1.1" 204 0
2025-12-04 10:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3752426-3988881-1004.jpg saved to cache
2025-12-04 10:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 07a43b40-c094-5b22-b61d-8f11e55e71c0
2025-12-04 10:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/FORD/KUGA?id=3754025&returnUrl=%2Fsearch%3FPage%3D4%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233754025&indx=374> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 10:04:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 10:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3752426-3988881-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003752426-01969136-004.pdf)
2025-12-04 10:04:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9 with identifier: 3754025
2025-12-04 10:04:35 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9
2025-12-04 10:04:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:04:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf30410>
2025-12-04 10:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:04:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07a43b40-c094-5b22-b61d-8f11e55e71c0/07a43b40-c094-5b22-b61d-8f11e55e71c0_image_17.jpg HTTP/1.1" 201 0
2025-12-04 10:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3752426-3988881-1003.jpg') HTTP/1.1" 204 0
2025-12-04 10:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3752426-3988881-1003.jpg saved to cache
2025-12-04 10:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 07a43b40-c094-5b22-b61d-8f11e55e71c0
2025-12-04 10:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3752426-3988881-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003752426-01969136-004.pdf)
2025-12-04 10:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3752426-3988881-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003752426-01969136-004.pdf)
2025-12-04 10:04:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:04:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:04:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:04:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd078050>
2025-12-04 10:04:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:04:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:04:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:04:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:04:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07a43b40-c094-5b22-b61d-8f11e55e71c0/07a43b40-c094-5b22-b61d-8f11e55e71c0_image_15.jpg HTTP/1.1" 201 0
2025-12-04 10:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3752426-3988881-1001.jpg') HTTP/1.1" 204 0
2025-12-04 10:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3752426-3988881-1001.jpg saved to cache
2025-12-04 10:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 07a43b40-c094-5b22-b61d-8f11e55e71c0
2025-12-04 10:04:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:04:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:04:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:04:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd107d10>
2025-12-04 10:04:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:04:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:04:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:04:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:04:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07a43b40-c094-5b22-b61d-8f11e55e71c0/07a43b40-c094-5b22-b61d-8f11e55e71c0_image_16.jpg HTTP/1.1" 201 0
2025-12-04 10:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3752426-3988881-1002.jpg') HTTP/1.1" 204 0
2025-12-04 10:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3752426-3988881-1002.jpg saved to cache
2025-12-04 10:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 07a43b40-c094-5b22-b61d-8f11e55e71c0
2025-12-04 10:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3752426-3988881-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003752426-01969136-004.pdf)
2025-12-04 10:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003754025-01985423-003.pdf> (referer: None)
2025-12-04 10:04:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:04:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:04:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:04:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ce8317d0>
2025-12-04 10:04:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:04:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:04:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:04:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:04:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07a43b40-c094-5b22-b61d-8f11e55e71c0/07a43b40-c094-5b22-b61d-8f11e55e71c0_image_14.jpg HTTP/1.1" 201 0
2025-12-04 10:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3752426-3988881-1000.jpg') HTTP/1.1" 204 0
2025-12-04 10:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3752426-3988881-1000.jpg saved to cache
2025-12-04 10:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 07a43b40-c094-5b22-b61d-8f11e55e71c0
2025-12-04 10:04:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:04:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:04:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:04:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccc5ef10>
2025-12-04 10:04:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:04:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:04:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:04:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:04:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9/7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9_expert_report_file_1b153a81-fe7f-4d3d-8b5b-89a430b0c7b2.pdf HTTP/1.1" 201 0
2025-12-04 10:04:37 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9
2025-12-04 10:04:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9, skipping ID generation
2025-12-04 10:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9
2025-12-04 10:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa2d35aa7-42b9-4382-922d-24fbd17f43e6_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a2d35aa7-42b9-4382-922d-24fbd17f43e6_ext_7.jpg not downloaded yet
2025-12-04 10:04:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/dbdb3c14-3fe2-450a-98a7-33597d0542ed_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003752426-01969136-004.pdf)
2025-12-04 10:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa2d35aa7-42b9-4382-922d-24fbd17f43e6_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a2d35aa7-42b9-4382-922d-24fbd17f43e6_ext_7.jpg not downloaded yet
2025-12-04 10:04:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3752426-3988881-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003752426-01969136-004.pdf)
2025-12-04 10:04:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/FORD/ECOSPORT?id=3748540&returnUrl=%2Fsearch%3FPage%3D4%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233748540&indx=367> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 10:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa2d35aa7-42b9-4382-922d-24fbd17f43e6_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a2d35aa7-42b9-4382-922d-24fbd17f43e6_ext_6.jpg not downloaded yet
2025-12-04 10:04:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 10:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa2d35aa7-42b9-4382-922d-24fbd17f43e6_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a2d35aa7-42b9-4382-922d-24fbd17f43e6_ext_1.jpg not downloaded yet
2025-12-04 10:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa2d35aa7-42b9-4382-922d-24fbd17f43e6_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a2d35aa7-42b9-4382-922d-24fbd17f43e6_5.jpg not downloaded yet
2025-12-04 10:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa2d35aa7-42b9-4382-922d-24fbd17f43e6_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a2d35aa7-42b9-4382-922d-24fbd17f43e6_4.jpg not downloaded yet
2025-12-04 10:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa2d35aa7-42b9-4382-922d-24fbd17f43e6_11.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a2d35aa7-42b9-4382-922d-24fbd17f43e6_11.jpg not downloaded yet
2025-12-04 10:04:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:04:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:04:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:04:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc713a10>
2025-12-04 10:04:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:04:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:04:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:04:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:04:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07a43b40-c094-5b22-b61d-8f11e55e71c0/07a43b40-c094-5b22-b61d-8f11e55e71c0_image_12.jpg HTTP/1.1" 201 0
2025-12-04 10:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdbdb3c14-3fe2-450a-98a7-33597d0542ed_ext_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dbdb3c14-3fe2-450a-98a7-33597d0542ed_ext_4.jpg saved to cache
2025-12-04 10:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 07a43b40-c094-5b22-b61d-8f11e55e71c0
2025-12-04 10:04:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:04:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:04:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:04:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc68c450>
2025-12-04 10:04:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:04:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:04:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:04:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:04:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07a43b40-c094-5b22-b61d-8f11e55e71c0/07a43b40-c094-5b22-b61d-8f11e55e71c0_image_13.jpg HTTP/1.1" 201 0
2025-12-04 10:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3752426-3988881-13.jpg') HTTP/1.1" 204 0
2025-12-04 10:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3752426-3988881-13.jpg saved to cache
2025-12-04 10:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 07a43b40-c094-5b22-b61d-8f11e55e71c0
2025-12-04 10:04:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2 with identifier: 3748540
2025-12-04 10:04:38 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2
2025-12-04 10:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa2d35aa7-42b9-4382-922d-24fbd17f43e6_10.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a2d35aa7-42b9-4382-922d-24fbd17f43e6_10.jpg not downloaded yet
2025-12-04 10:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa2d35aa7-42b9-4382-922d-24fbd17f43e6_9.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a2d35aa7-42b9-4382-922d-24fbd17f43e6_9.jpg not downloaded yet
2025-12-04 10:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/dbdb3c14-3fe2-450a-98a7-33597d0542ed_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003752426-01969136-004.pdf)
2025-12-04 10:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a2d35aa7-42b9-4382-922d-24fbd17f43e6_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003754025-01985423-003.pdf)
2025-12-04 10:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a2d35aa7-42b9-4382-922d-24fbd17f43e6_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003754025-01985423-003.pdf)
2025-12-04 10:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa2d35aa7-42b9-4382-922d-24fbd17f43e6_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a2d35aa7-42b9-4382-922d-24fbd17f43e6_ext_2.jpg not downloaded yet
2025-12-04 10:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa2d35aa7-42b9-4382-922d-24fbd17f43e6_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a2d35aa7-42b9-4382-922d-24fbd17f43e6_ext_5.jpg not downloaded yet
2025-12-04 10:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa2d35aa7-42b9-4382-922d-24fbd17f43e6_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a2d35aa7-42b9-4382-922d-24fbd17f43e6_ext_3.jpg not downloaded yet
2025-12-04 10:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa2d35aa7-42b9-4382-922d-24fbd17f43e6_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a2d35aa7-42b9-4382-922d-24fbd17f43e6_ext_4.jpg not downloaded yet
2025-12-04 10:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3754025-4001984-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3754025-4001984-13.jpg not downloaded yet
2025-12-04 10:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3754025-4001984-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3754025-4001984-1000.jpg not downloaded yet
2025-12-04 10:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3754025-4001984-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3754025-4001984-1001.jpg not downloaded yet
2025-12-04 10:04:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:04:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:04:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:04:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5c8d50>
2025-12-04 10:04:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:04:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:04:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07a43b40-c094-5b22-b61d-8f11e55e71c0/07a43b40-c094-5b22-b61d-8f11e55e71c0_image_11.jpg HTTP/1.1" 201 0
2025-12-04 10:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdbdb3c14-3fe2-450a-98a7-33597d0542ed_ext_3.jpg') HTTP/1.1" 204 0
2025-12-04 10:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dbdb3c14-3fe2-450a-98a7-33597d0542ed_ext_3.jpg saved to cache
2025-12-04 10:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 07a43b40-c094-5b22-b61d-8f11e55e71c0
2025-12-04 10:04:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:04:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:04:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:04:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc53fc50>
2025-12-04 10:04:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:04:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:04:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9/7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9_image_0.jpg HTTP/1.1" 201 0
2025-12-04 10:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa2d35aa7-42b9-4382-922d-24fbd17f43e6_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a2d35aa7-42b9-4382-922d-24fbd17f43e6_ext_7.jpg saved to cache
2025-12-04 10:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9
2025-12-04 10:04:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:04:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:04:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:04:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc53d610>
2025-12-04 10:04:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:04:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:04:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9/7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9_image_1.jpg HTTP/1.1" 201 0
2025-12-04 10:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa2d35aa7-42b9-4382-922d-24fbd17f43e6_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a2d35aa7-42b9-4382-922d-24fbd17f43e6_ext_7.jpg saved to cache
2025-12-04 10:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9
2025-12-04 10:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3754025-4001984-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3754025-4001984-1002.jpg not downloaded yet
2025-12-04 10:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3754025-4001984-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3754025-4001984-1003.jpg not downloaded yet
2025-12-04 10:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a2d35aa7-42b9-4382-922d-24fbd17f43e6_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003754025-01985423-003.pdf)
2025-12-04 10:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a2d35aa7-42b9-4382-922d-24fbd17f43e6_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003754025-01985423-003.pdf)
2025-12-04 10:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3754025-4001984-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3754025-4001984-1004.jpg not downloaded yet
2025-12-04 10:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3754025-4001984-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3754025-4001984-1005.jpg not downloaded yet
2025-12-04 10:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003748540-01982276-004.pdf> (referer: None)
2025-12-04 10:04:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:04:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:04:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:04:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc68f150>
2025-12-04 10:04:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:04:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:04:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9/7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9_image_7.jpg HTTP/1.1" 201 0
2025-12-04 10:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa2d35aa7-42b9-4382-922d-24fbd17f43e6_10.jpg') HTTP/1.1" 204 0
2025-12-04 10:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a2d35aa7-42b9-4382-922d-24fbd17f43e6_10.jpg saved to cache
2025-12-04 10:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9
2025-12-04 10:04:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:04:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:04:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:04:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccfb9210>
2025-12-04 10:04:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:04:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:04:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9/7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9_image_8.jpg HTTP/1.1" 201 0
2025-12-04 10:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa2d35aa7-42b9-4382-922d-24fbd17f43e6_9.jpg') HTTP/1.1" 204 0
2025-12-04 10:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a2d35aa7-42b9-4382-922d-24fbd17f43e6_9.jpg saved to cache
2025-12-04 10:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9
2025-12-04 10:04:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:04:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:04:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:04:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6d0250>
2025-12-04 10:04:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:04:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2/3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2_expert_report_file_70626719-7a78-43ad-9392-0f5e4013b821.pdf HTTP/1.1" 201 0
2025-12-04 10:04:40 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2
2025-12-04 10:04:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2, skipping ID generation
2025-12-04 10:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 19 photos for item 3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2
2025-12-04 10:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5c587f9d-7f04-4b66-a9b4-d481fa56b617_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5c587f9d-7f04-4b66-a9b4-d481fa56b617_ext_7.jpg not downloaded yet
2025-12-04 10:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3754025-4001984-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003754025-01985423-003.pdf)
2025-12-04 10:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3754025-4001984-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003754025-01985423-003.pdf)
2025-12-04 10:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5c587f9d-7f04-4b66-a9b4-d481fa56b617_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5c587f9d-7f04-4b66-a9b4-d481fa56b617_ext_7.jpg not downloaded yet
2025-12-04 10:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5c587f9d-7f04-4b66-a9b4-d481fa56b617_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5c587f9d-7f04-4b66-a9b4-d481fa56b617_ext_6.jpg not downloaded yet
2025-12-04 10:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3754025-4001984-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003754025-01985423-003.pdf)
2025-12-04 10:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5c587f9d-7f04-4b66-a9b4-d481fa56b617_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5c587f9d-7f04-4b66-a9b4-d481fa56b617_ext_1.jpg not downloaded yet
2025-12-04 10:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5c587f9d-7f04-4b66-a9b4-d481fa56b617_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5c587f9d-7f04-4b66-a9b4-d481fa56b617_5.jpg not downloaded yet
2025-12-04 10:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5c587f9d-7f04-4b66-a9b4-d481fa56b617_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5c587f9d-7f04-4b66-a9b4-d481fa56b617_4.jpg not downloaded yet
2025-12-04 10:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5c587f9d-7f04-4b66-a9b4-d481fa56b617_11.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5c587f9d-7f04-4b66-a9b4-d481fa56b617_11.jpg not downloaded yet
2025-12-04 10:04:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:04:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc54dcd0>
2025-12-04 10:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:04:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9/7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9_image_17.jpg HTTP/1.1" 201 0
2025-12-04 10:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3754025-4001984-1003.jpg') HTTP/1.1" 204 0
2025-12-04 10:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3754025-4001984-1003.jpg saved to cache
2025-12-04 10:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9
2025-12-04 10:04:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:04:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd4b5d0>
2025-12-04 10:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:04:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9/7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9_image_16.jpg HTTP/1.1" 201 0
2025-12-04 10:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3754025-4001984-1002.jpg') HTTP/1.1" 204 0
2025-12-04 10:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3754025-4001984-1002.jpg saved to cache
2025-12-04 10:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9
2025-12-04 10:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5c587f9d-7f04-4b66-a9b4-d481fa56b617_10.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5c587f9d-7f04-4b66-a9b4-d481fa56b617_10.jpg not downloaded yet
2025-12-04 10:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5c587f9d-7f04-4b66-a9b4-d481fa56b617_9.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5c587f9d-7f04-4b66-a9b4-d481fa56b617_9.jpg not downloaded yet
2025-12-04 10:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=3754451&returnUrl=%2Fsearch%3FPage%3D4%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233754451&indx=375> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 10:04:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 10:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5c587f9d-7f04-4b66-a9b4-d481fa56b617_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003748540-01982276-004.pdf)
2025-12-04 10:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5c587f9d-7f04-4b66-a9b4-d481fa56b617_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003748540-01982276-004.pdf)
2025-12-04 10:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3754025-4001984-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003754025-01985423-003.pdf)
2025-12-04 10:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5c587f9d-7f04-4b66-a9b4-d481fa56b617_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5c587f9d-7f04-4b66-a9b4-d481fa56b617_ext_2.jpg not downloaded yet
2025-12-04 10:04:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:04:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:04:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:04:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccced550>
2025-12-04 10:04:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:04:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:04:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9/7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9_image_19.jpg HTTP/1.1" 201 0
2025-12-04 10:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3754025-4001984-1005.jpg') HTTP/1.1" 204 0
2025-12-04 10:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3754025-4001984-1005.jpg saved to cache
2025-12-04 10:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9
2025-12-04 10:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5c587f9d-7f04-4b66-a9b4-d481fa56b617_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5c587f9d-7f04-4b66-a9b4-d481fa56b617_ext_5.jpg not downloaded yet
2025-12-04 10:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5c587f9d-7f04-4b66-a9b4-d481fa56b617_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5c587f9d-7f04-4b66-a9b4-d481fa56b617_ext_3.jpg not downloaded yet
2025-12-04 10:04:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: add22426-51c3-51e2-8fc1-69c57bb457ca with identifier: 3754451
2025-12-04 10:04:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item add22426-51c3-51e2-8fc1-69c57bb457ca with scrape type 1
2025-12-04 10:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item add22426-51c3-51e2-8fc1-69c57bb457ca
2025-12-04 10:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fawaiting-image-002.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/awaiting-image-002.jpg already downloaded
2025-12-04 10:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fawaiting-image-002.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/awaiting-image-002.jpg already downloaded
2025-12-04 10:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3754451-4007687-3.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3754451-4007687-3.jpg not downloaded yet
2025-12-04 10:04:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:04:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:04:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:04:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd062b50>
2025-12-04 10:04:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:04:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:04:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2/3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2_image_0.jpg HTTP/1.1" 201 0
2025-12-04 10:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5c587f9d-7f04-4b66-a9b4-d481fa56b617_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5c587f9d-7f04-4b66-a9b4-d481fa56b617_ext_7.jpg saved to cache
2025-12-04 10:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2
2025-12-04 10:04:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:04:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:04:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:04:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccfe30d0>
2025-12-04 10:04:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:04:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:04:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2/3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2_image_1.jpg HTTP/1.1" 201 0
2025-12-04 10:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5c587f9d-7f04-4b66-a9b4-d481fa56b617_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5c587f9d-7f04-4b66-a9b4-d481fa56b617_ext_7.jpg saved to cache
2025-12-04 10:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2
2025-12-04 10:04:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:04:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:04:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:04:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccdb6c10>
2025-12-04 10:04:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:04:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:04:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9/7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9_image_18.jpg HTTP/1.1" 201 0
2025-12-04 10:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3754025-4001984-1004.jpg') HTTP/1.1" 204 0
2025-12-04 10:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3754025-4001984-1004.jpg saved to cache
2025-12-04 10:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9
2025-12-04 10:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5c587f9d-7f04-4b66-a9b4-d481fa56b617_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5c587f9d-7f04-4b66-a9b4-d481fa56b617_ext_4.jpg not downloaded yet
2025-12-04 10:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3754451-4007687-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3754451-4007687-13.jpg not downloaded yet
2025-12-04 10:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3748540-3994608-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3748540-3994608-13.jpg not downloaded yet
2025-12-04 10:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3754451-4007687-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3754451-4007687-1000.jpg not downloaded yet
2025-12-04 10:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5c587f9d-7f04-4b66-a9b4-d481fa56b617_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003748540-01982276-004.pdf)
2025-12-04 10:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5c587f9d-7f04-4b66-a9b4-d481fa56b617_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003748540-01982276-004.pdf)
2025-12-04 10:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5c587f9d-7f04-4b66-a9b4-d481fa56b617_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003748540-01982276-004.pdf)
2025-12-04 10:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5c587f9d-7f04-4b66-a9b4-d481fa56b617_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003748540-01982276-004.pdf)
2025-12-04 10:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3748540-3994608-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3748540-3994608-1000.jpg not downloaded yet
2025-12-04 10:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3754451-4007687-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3754451-4007687-1001.jpg not downloaded yet
2025-12-04 10:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3748540-3994608-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3748540-3994608-1001.jpg not downloaded yet
2025-12-04 10:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3754451-4007687-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3754451-4007687-1002.jpg not downloaded yet
2025-12-04 10:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3748540-3994608-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3748540-3994608-1002.jpg not downloaded yet
2025-12-04 10:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3754451-4007687-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3754451-4007687-1003.jpg not downloaded yet
2025-12-04 10:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3748540-3994608-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3748540-3994608-1003.jpg not downloaded yet
2025-12-04 10:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3754451-4007687-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3754451-4007687-1004.jpg not downloaded yet
2025-12-04 10:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3748540-3994608-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3748540-3994608-1004.jpg not downloaded yet
2025-12-04 10:04:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:04:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:04:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:04:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd899d0>
2025-12-04 10:04:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:04:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:04:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2/3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2_image_5.jpg HTTP/1.1" 201 0
2025-12-04 10:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5c587f9d-7f04-4b66-a9b4-d481fa56b617_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5c587f9d-7f04-4b66-a9b4-d481fa56b617_4.jpg saved to cache
2025-12-04 10:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2
2025-12-04 10:04:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:04:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:04:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:04:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5737d0>
2025-12-04 10:04:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:04:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:04:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2/3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2_image_6.jpg HTTP/1.1" 201 0
2025-12-04 10:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5c587f9d-7f04-4b66-a9b4-d481fa56b617_11.jpg') HTTP/1.1" 204 0
2025-12-04 10:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5c587f9d-7f04-4b66-a9b4-d481fa56b617_11.jpg saved to cache
2025-12-04 10:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2
2025-12-04 10:04:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:04:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:04:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:04:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc71a850>
2025-12-04 10:04:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:04:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2/3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2_image_8.jpg HTTP/1.1" 201 0
2025-12-04 10:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5c587f9d-7f04-4b66-a9b4-d481fa56b617_9.jpg') HTTP/1.1" 204 0
2025-12-04 10:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5c587f9d-7f04-4b66-a9b4-d481fa56b617_9.jpg saved to cache
2025-12-04 10:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2
2025-12-04 10:04:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:04:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccfbdf50>
2025-12-04 10:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:04:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2/3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2_image_7.jpg HTTP/1.1" 201 0
2025-12-04 10:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5c587f9d-7f04-4b66-a9b4-d481fa56b617_10.jpg') HTTP/1.1" 204 0
2025-12-04 10:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5c587f9d-7f04-4b66-a9b4-d481fa56b617_10.jpg saved to cache
2025-12-04 10:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2
2025-12-04 10:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3754451-4007687-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3754451-4007687-1005.jpg not downloaded yet
2025-12-04 10:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3754451-4007687-1006.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3754451-4007687-1006.jpg not downloaded yet
2025-12-04 10:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3754451-4007687-3.jpg> (referer: None)
2025-12-04 10:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5c587f9d-7f04-4b66-a9b4-d481fa56b617_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003748540-01982276-004.pdf)
2025-12-04 10:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3754451-4007687-1007.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3754451-4007687-1007.jpg not downloaded yet
2025-12-04 10:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3748540-3994608-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003748540-01982276-004.pdf)
2025-12-04 10:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3754451-4007687-13.jpg> (referer: None)
2025-12-04 10:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3754451-4007687-1008.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3754451-4007687-1008.jpg not downloaded yet
2025-12-04 10:04:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:04:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc71a010>
2025-12-04 10:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:04:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_add22426-51c3-51e2-8fc1-69c57bb457ca/add22426-51c3-51e2-8fc1-69c57bb457ca_image_2.jpg HTTP/1.1" 201 0
2025-12-04 10:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3754451-4007687-3.jpg') HTTP/1.1" 204 0
2025-12-04 10:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3754451-4007687-3.jpg saved to cache
2025-12-04 10:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item add22426-51c3-51e2-8fc1-69c57bb457ca
2025-12-04 10:04:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:04:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ce365d10>
2025-12-04 10:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:04:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2/3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2_image_12.jpg HTTP/1.1" 201 0
2025-12-04 10:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5c587f9d-7f04-4b66-a9b4-d481fa56b617_ext_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5c587f9d-7f04-4b66-a9b4-d481fa56b617_ext_4.jpg saved to cache
2025-12-04 10:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2
2025-12-04 10:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3754451-4007687-1005.jpg> (referer: None)
2025-12-04 10:04:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:04:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd045050>
2025-12-04 10:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:04:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2/3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2_image_13.jpg HTTP/1.1" 201 0
2025-12-04 10:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3748540-3994608-13.jpg') HTTP/1.1" 204 0
2025-12-04 10:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3748540-3994608-13.jpg saved to cache
2025-12-04 10:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2
2025-12-04 10:04:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:04:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd107c10>
2025-12-04 10:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:04:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_add22426-51c3-51e2-8fc1-69c57bb457ca/add22426-51c3-51e2-8fc1-69c57bb457ca_image_3.jpg HTTP/1.1" 201 0
2025-12-04 10:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3754451-4007687-13.jpg') HTTP/1.1" 204 0
2025-12-04 10:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3754451-4007687-13.jpg saved to cache
2025-12-04 10:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item add22426-51c3-51e2-8fc1-69c57bb457ca
2025-12-04 10:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3748540-3994608-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003748540-01982276-004.pdf)
2025-12-04 10:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3754451-4007687-1006.jpg> (referer: None)
2025-12-04 10:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3754451-4007687-1007.jpg> (referer: None)
2025-12-04 10:04:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:04:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6506d0>
2025-12-04 10:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:04:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_add22426-51c3-51e2-8fc1-69c57bb457ca/add22426-51c3-51e2-8fc1-69c57bb457ca_image_9.jpg HTTP/1.1" 201 0
2025-12-04 10:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3754451-4007687-1005.jpg') HTTP/1.1" 204 0
2025-12-04 10:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3754451-4007687-1005.jpg saved to cache
2025-12-04 10:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item add22426-51c3-51e2-8fc1-69c57bb457ca
2025-12-04 10:04:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:04:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc54f090>
2025-12-04 10:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:04:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2/3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2_image_18.jpg HTTP/1.1" 201 0
2025-12-04 10:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3748540-3994608-1004.jpg') HTTP/1.1" 204 0
2025-12-04 10:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3748540-3994608-1004.jpg saved to cache
2025-12-04 10:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2
2025-12-04 10:04:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:04:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd811d0>
2025-12-04 10:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:04:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_add22426-51c3-51e2-8fc1-69c57bb457ca/add22426-51c3-51e2-8fc1-69c57bb457ca_image_10.jpg HTTP/1.1" 201 0
2025-12-04 10:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3754451-4007687-1006.jpg') HTTP/1.1" 204 0
2025-12-04 10:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3754451-4007687-1006.jpg saved to cache
2025-12-04 10:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item add22426-51c3-51e2-8fc1-69c57bb457ca
2025-12-04 10:04:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:04:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5f6ed0>
2025-12-04 10:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:04:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_add22426-51c3-51e2-8fc1-69c57bb457ca/add22426-51c3-51e2-8fc1-69c57bb457ca_image_11.jpg HTTP/1.1" 201 0
2025-12-04 10:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3754451-4007687-1007.jpg') HTTP/1.1" 204 0
2025-12-04 10:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3754451-4007687-1007.jpg saved to cache
2025-12-04 10:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item add22426-51c3-51e2-8fc1-69c57bb457ca
2025-12-04 10:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/KIA/SORENTO?id=3751763&returnUrl=%2Fsearch%3FPage%3D4%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233751763&indx=368> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 10:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3754451-4007687-1008.jpg> (referer: None)
2025-12-04 10:04:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 10:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3748540-3994608-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003748540-01982276-004.pdf)
2025-12-04 10:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3754451-4007687-1004.jpg> (referer: None)
2025-12-04 10:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3754451-4007687-1003.jpg> (referer: None)
2025-12-04 10:04:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db5cc1b6-171e-522d-9cb0-60610e43d78f with identifier: 3751763
2025-12-04 10:04:47 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item db5cc1b6-171e-522d-9cb0-60610e43d78f
2025-12-04 10:04:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:04:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccfaf410>
2025-12-04 10:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:04:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_add22426-51c3-51e2-8fc1-69c57bb457ca/add22426-51c3-51e2-8fc1-69c57bb457ca_image_12.jpg HTTP/1.1" 201 0
2025-12-04 10:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3754451-4007687-1008.jpg') HTTP/1.1" 204 0
2025-12-04 10:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3754451-4007687-1008.jpg saved to cache
2025-12-04 10:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item add22426-51c3-51e2-8fc1-69c57bb457ca
2025-12-04 10:04:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:04:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd779d0>
2025-12-04 10:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:04:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2/3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2_image_17.jpg HTTP/1.1" 201 0
2025-12-04 10:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3748540-3994608-1003.jpg') HTTP/1.1" 204 0
2025-12-04 10:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3748540-3994608-1003.jpg saved to cache
2025-12-04 10:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2
2025-12-04 10:04:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:04:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc694610>
2025-12-04 10:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:04:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_add22426-51c3-51e2-8fc1-69c57bb457ca/add22426-51c3-51e2-8fc1-69c57bb457ca_image_8.jpg HTTP/1.1" 201 0
2025-12-04 10:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3754451-4007687-1004.jpg') HTTP/1.1" 204 0
2025-12-04 10:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3754451-4007687-1004.jpg saved to cache
2025-12-04 10:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item add22426-51c3-51e2-8fc1-69c57bb457ca
2025-12-04 10:04:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:04:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccca5d50>
2025-12-04 10:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:04:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_add22426-51c3-51e2-8fc1-69c57bb457ca/add22426-51c3-51e2-8fc1-69c57bb457ca_image_7.jpg HTTP/1.1" 201 0
2025-12-04 10:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3754451-4007687-1003.jpg') HTTP/1.1" 204 0
2025-12-04 10:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3754451-4007687-1003.jpg saved to cache
2025-12-04 10:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item add22426-51c3-51e2-8fc1-69c57bb457ca
2025-12-04 10:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3754451-4007687-1002.jpg> (referer: None)
2025-12-04 10:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3754451-4007687-1001.jpg> (referer: None)
2025-12-04 10:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3748540-3994608-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003748540-01982276-004.pdf)
2025-12-04 10:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3748540-3994608-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003748540-01982276-004.pdf)
2025-12-04 10:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3748540-3994608-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003748540-01982276-004.pdf)
2025-12-04 10:04:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:04:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc619550>
2025-12-04 10:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:04:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_add22426-51c3-51e2-8fc1-69c57bb457ca/add22426-51c3-51e2-8fc1-69c57bb457ca_image_6.jpg HTTP/1.1" 201 0
2025-12-04 10:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3754451-4007687-1002.jpg') HTTP/1.1" 204 0
2025-12-04 10:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3754451-4007687-1002.jpg saved to cache
2025-12-04 10:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item add22426-51c3-51e2-8fc1-69c57bb457ca
2025-12-04 10:04:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:04:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc7f7bd0>
2025-12-04 10:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:04:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_add22426-51c3-51e2-8fc1-69c57bb457ca/add22426-51c3-51e2-8fc1-69c57bb457ca_image_5.jpg HTTP/1.1" 201 0
2025-12-04 10:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3754451-4007687-1001.jpg') HTTP/1.1" 204 0
2025-12-04 10:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3754451-4007687-1001.jpg saved to cache
2025-12-04 10:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item add22426-51c3-51e2-8fc1-69c57bb457ca
2025-12-04 10:04:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:04:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd0aad0>
2025-12-04 10:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:04:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:04:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2/3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2_image_14.jpg HTTP/1.1" 201 0
2025-12-04 10:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3748540-3994608-1000.jpg') HTTP/1.1" 204 0
2025-12-04 10:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3748540-3994608-1000.jpg saved to cache
2025-12-04 10:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2
2025-12-04 10:04:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:04:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:04:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:04:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd028a10>
2025-12-04 10:04:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:04:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 10:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:04:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2/3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2_image_16.jpg HTTP/1.1" 201 0
2025-12-04 10:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3748540-3994608-1002.jpg') HTTP/1.1" 204 0
2025-12-04 10:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3748540-3994608-1002.jpg saved to cache
2025-12-04 10:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2
2025-12-04 10:04:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:04:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:04:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:04:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd0e8210>
2025-12-04 10:04:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:04:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:04:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2/3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2_image_15.jpg HTTP/1.1" 201 0
2025-12-04 10:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3748540-3994608-1001.jpg') HTTP/1.1" 204 0
2025-12-04 10:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3748540-3994608-1001.jpg saved to cache
2025-12-04 10:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2
2025-12-04 10:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3754451-4007687-1000.jpg> (referer: None)
2025-12-04 10:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5c587f9d-7f04-4b66-a9b4-d481fa56b617_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003748540-01982276-004.pdf)
2025-12-04 10:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5c587f9d-7f04-4b66-a9b4-d481fa56b617_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003748540-01982276-004.pdf)
2025-12-04 10:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5c587f9d-7f04-4b66-a9b4-d481fa56b617_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003748540-01982276-004.pdf)
2025-12-04 10:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003751763-01954244-003.pdf> (referer: None)
2025-12-04 10:04:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:04:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:04:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:04:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce6a090>
2025-12-04 10:04:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:04:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:04:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:04:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_add22426-51c3-51e2-8fc1-69c57bb457ca/add22426-51c3-51e2-8fc1-69c57bb457ca_image_4.jpg HTTP/1.1" 201 0
2025-12-04 10:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3754451-4007687-1000.jpg') HTTP/1.1" 204 0
2025-12-04 10:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3754451-4007687-1000.jpg saved to cache
2025-12-04 10:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item add22426-51c3-51e2-8fc1-69c57bb457ca
2025-12-04 10:04:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: add22426-51c3-51e2-8fc1-69c57bb457ca, skipping ID generation
2025-12-04 10:04:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item add22426-51c3-51e2-8fc1-69c57bb457ca with scrape type 1
2025-12-04 10:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Removing item add22426-51c3-51e2-8fc1-69c57bb457ca from tracking dictionaries
2025-12-04 10:04:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item add22426-51c3-51e2-8fc1-69c57bb457ca sending to next pipeline
2025-12-04 10:04:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: add22426-51c3-51e2-8fc1-69c57bb457ca, identifier: 3754451
2025-12-04 10:04:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: add22426-51c3-51e2-8fc1-69c57bb457ca with identifier: 3754451
2025-12-04 10:04:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: add22426-51c3-51e2-8fc1-69c57bb457ca with identifier: 3754451
2025-12-04 10:04:50 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: add22426-51c3-51e2-8fc1-69c57bb457ca with identifier: 3754451 to the API
2025-12-04 10:04:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 10:04:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 10:04:52 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/insp-0001-3754451-4007687-1000.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'car_expert_report_source_url': None,
 'color': 'SILVER',
 'currency': 'GBP',
 'engine': '1.3L',
 'expiration_date': '2025-12-05T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'add22426-51c3-51e2-8fc1-69c57bb457ca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'VU19EKD',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=3754451',
 'listing': 'auction',
 'location': 'Washington',
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 59015,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4622c3ba-5515-5758-814e-2f49e4247fa1/4622c3ba-5515-5758-814e-2f49e4247fa1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72484,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/awaiting-image-002.jpg',
             'Width': 1322},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4622c3ba-5515-5758-814e-2f49e4247fa1/4622c3ba-5515-5758-814e-2f49e4247fa1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72484,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/awaiting-image-002.jpg',
             'Width': 1322},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_add22426-51c3-51e2-8fc1-69c57bb457ca/add22426-51c3-51e2-8fc1-69c57bb457ca_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 184777,
             'Height': 843,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3754451-4007687-3.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_add22426-51c3-51e2-8fc1-69c57bb457ca/add22426-51c3-51e2-8fc1-69c57bb457ca_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 325776,
             'Height': 843,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3754451-4007687-13.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_add22426-51c3-51e2-8fc1-69c57bb457ca/add22426-51c3-51e2-8fc1-69c57bb457ca_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 139973,
             'Height': 843,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3754451-4007687-1000.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_add22426-51c3-51e2-8fc1-69c57bb457ca/add22426-51c3-51e2-8fc1-69c57bb457ca_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 132491,
             'Height': 843,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3754451-4007687-1001.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_add22426-51c3-51e2-8fc1-69c57bb457ca/add22426-51c3-51e2-8fc1-69c57bb457ca_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 157561,
             'Height': 843,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3754451-4007687-1002.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_add22426-51c3-51e2-8fc1-69c57bb457ca/add22426-51c3-51e2-8fc1-69c57bb457ca_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 149739,
             'Height': 843,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3754451-4007687-1003.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_add22426-51c3-51e2-8fc1-69c57bb457ca/add22426-51c3-51e2-8fc1-69c57bb457ca_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 199257,
             'Height': 843,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3754451-4007687-1004.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_add22426-51c3-51e2-8fc1-69c57bb457ca/add22426-51c3-51e2-8fc1-69c57bb457ca_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103187,
             'Height': 843,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3754451-4007687-1005.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_add22426-51c3-51e2-8fc1-69c57bb457ca/add22426-51c3-51e2-8fc1-69c57bb457ca_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 134334,
             'Height': 843,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3754451-4007687-1006.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_add22426-51c3-51e2-8fc1-69c57bb457ca/add22426-51c3-51e2-8fc1-69c57bb457ca_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 251431,
             'Height': 843,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3754451-4007687-1007.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_add22426-51c3-51e2-8fc1-69c57bb457ca/add22426-51c3-51e2-8fc1-69c57bb457ca_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 162522,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3754451-4007687-1008.jpg',
             'Width': 562}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-01',
 'seller_name': 'Mobilize Financial Services',
 'title': 'NISSAN QASHQAI 1.3 DiG-T Acenta Premium 5dr',
 'transmission': 'manual',
 'trim': '1.3 DiG-T Acenta Premium 5dr',
 'year': 2019}
2025-12-04 10:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273754451%27 HTTP/1.1" 200 None
2025-12-04 10:04:52 [manheim.gb] INFO: Saving data for 3754451: {'created_time': 1764842692.244357, 'last_price_update_time': 1764842692.244367, 'auction_closing_time': 1764925200.0}
2025-12-04 10:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3754451') HTTP/1.1" 204 0
2025-12-04 10:04:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:04:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:04:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:04:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc726e10>
2025-12-04 10:04:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:04:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:04:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2/3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2_image_10.jpg HTTP/1.1" 201 0
2025-12-04 10:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5c587f9d-7f04-4b66-a9b4-d481fa56b617_ext_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5c587f9d-7f04-4b66-a9b4-d481fa56b617_ext_5.jpg saved to cache
2025-12-04 10:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2
2025-12-04 10:04:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:04:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:04:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:04:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd104090>
2025-12-04 10:04:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:04:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:04:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2/3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2_image_11.jpg HTTP/1.1" 201 0
2025-12-04 10:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5c587f9d-7f04-4b66-a9b4-d481fa56b617_ext_3.jpg') HTTP/1.1" 204 0
2025-12-04 10:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5c587f9d-7f04-4b66-a9b4-d481fa56b617_ext_3.jpg saved to cache
2025-12-04 10:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2
2025-12-04 10:04:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:04:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:04:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:04:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5f7650>
2025-12-04 10:04:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:04:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2/3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2_image_9.jpg HTTP/1.1" 201 0
2025-12-04 10:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5c587f9d-7f04-4b66-a9b4-d481fa56b617_ext_2.jpg') HTTP/1.1" 204 0
2025-12-04 10:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5c587f9d-7f04-4b66-a9b4-d481fa56b617_ext_2.jpg saved to cache
2025-12-04 10:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2
2025-12-04 10:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5c587f9d-7f04-4b66-a9b4-d481fa56b617_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003748540-01982276-004.pdf)
2025-12-04 10:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5c587f9d-7f04-4b66-a9b4-d481fa56b617_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003748540-01982276-004.pdf)
2025-12-04 10:04:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:04:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:04:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:04:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccfaf490>
2025-12-04 10:04:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:04:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:04:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:04:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db5cc1b6-171e-522d-9cb0-60610e43d78f/db5cc1b6-171e-522d-9cb0-60610e43d78f_expert_report_file_894c783b-7d41-4756-8fff-490060469196.pdf HTTP/1.1" 201 0
2025-12-04 10:04:53 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item db5cc1b6-171e-522d-9cb0-60610e43d78f
2025-12-04 10:04:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: db5cc1b6-171e-522d-9cb0-60610e43d78f, skipping ID generation
2025-12-04 10:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item db5cc1b6-171e-522d-9cb0-60610e43d78f
2025-12-04 10:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa2c0380c-8fcb-4c4f-bcd1-df151e486a86_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a2c0380c-8fcb-4c4f-bcd1-df151e486a86_ext_7.jpg not downloaded yet
2025-12-04 10:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5c587f9d-7f04-4b66-a9b4-d481fa56b617_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003748540-01982276-004.pdf)
2025-12-04 10:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3754025-4001984-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003754025-01985423-003.pdf)
2025-12-04 10:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3754025-4001984-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003754025-01985423-003.pdf)
2025-12-04 10:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa2c0380c-8fcb-4c4f-bcd1-df151e486a86_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a2c0380c-8fcb-4c4f-bcd1-df151e486a86_ext_7.jpg not downloaded yet
2025-12-04 10:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/EQV?id=3740756&returnUrl=%2Fsearch%3FPage%3D4%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233740756&indx=365> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 10:04:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 10:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa2c0380c-8fcb-4c4f-bcd1-df151e486a86_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a2c0380c-8fcb-4c4f-bcd1-df151e486a86_ext_6.jpg not downloaded yet
2025-12-04 10:04:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:04:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:04:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:04:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5bcc90>
2025-12-04 10:04:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:04:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:04:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:04:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2/3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2_image_4.jpg HTTP/1.1" 201 0
2025-12-04 10:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5c587f9d-7f04-4b66-a9b4-d481fa56b617_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5c587f9d-7f04-4b66-a9b4-d481fa56b617_5.jpg saved to cache
2025-12-04 10:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2
2025-12-04 10:04:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:04:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:04:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:04:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd487d0>
2025-12-04 10:04:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:04:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:04:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:04:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2/3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2_image_3.jpg HTTP/1.1" 201 0
2025-12-04 10:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5c587f9d-7f04-4b66-a9b4-d481fa56b617_ext_1.jpg') HTTP/1.1" 204 0
2025-12-04 10:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5c587f9d-7f04-4b66-a9b4-d481fa56b617_ext_1.jpg saved to cache
2025-12-04 10:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2
2025-12-04 10:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa2c0380c-8fcb-4c4f-bcd1-df151e486a86_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a2c0380c-8fcb-4c4f-bcd1-df151e486a86_ext_1.jpg not downloaded yet
2025-12-04 10:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a2d35aa7-42b9-4382-922d-24fbd17f43e6_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003754025-01985423-003.pdf)
2025-12-04 10:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa2c0380c-8fcb-4c4f-bcd1-df151e486a86_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a2c0380c-8fcb-4c4f-bcd1-df151e486a86_5.jpg not downloaded yet
2025-12-04 10:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a2c0380c-8fcb-4c4f-bcd1-df151e486a86_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003751763-01954244-003.pdf)
2025-12-04 10:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a2d35aa7-42b9-4382-922d-24fbd17f43e6_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003754025-01985423-003.pdf)
2025-12-04 10:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a2d35aa7-42b9-4382-922d-24fbd17f43e6_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003754025-01985423-003.pdf)
2025-12-04 10:04:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:04:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd8a050>
2025-12-04 10:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:04:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2/3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2_image_2.jpg HTTP/1.1" 201 0
2025-12-04 10:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5c587f9d-7f04-4b66-a9b4-d481fa56b617_ext_6.jpg') HTTP/1.1" 204 0
2025-12-04 10:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5c587f9d-7f04-4b66-a9b4-d481fa56b617_ext_6.jpg saved to cache
2025-12-04 10:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2
2025-12-04 10:04:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2, skipping ID generation
2025-12-04 10:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2 from tracking dictionaries
2025-12-04 10:04:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2 sending to next pipeline
2025-12-04 10:04:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2, identifier: 3748540
2025-12-04 10:04:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:04:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5f7ad0>
2025-12-04 10:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:04:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9/7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9_image_15.jpg HTTP/1.1" 201 0
2025-12-04 10:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3754025-4001984-1001.jpg') HTTP/1.1" 204 0
2025-12-04 10:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3754025-4001984-1001.jpg saved to cache
2025-12-04 10:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9
2025-12-04 10:04:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:04:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf9c910>
2025-12-04 10:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:04:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9/7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9_image_14.jpg HTTP/1.1" 201 0
2025-12-04 10:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3754025-4001984-1000.jpg') HTTP/1.1" 204 0
2025-12-04 10:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3754025-4001984-1000.jpg saved to cache
2025-12-04 10:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9
2025-12-04 10:04:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27c40b73-4217-5525-8def-8f7189d22661 with identifier: 3740756
2025-12-04 10:04:55 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 27c40b73-4217-5525-8def-8f7189d22661
2025-12-04 10:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa2c0380c-8fcb-4c4f-bcd1-df151e486a86_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a2c0380c-8fcb-4c4f-bcd1-df151e486a86_4.jpg not downloaded yet
2025-12-04 10:04:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2 with identifier: 3748540
2025-12-04 10:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-04 10:04:55 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=ORANGE HTTP/1.1" 200 None
2025-12-04 10:04:55 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-04 10:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-04 10:04:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2 with identifier: 3748540
2025-12-04 10:04:55 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2 with identifier: 3748540 to the API
2025-12-04 10:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 10:04:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 10:04:55 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/5c587f9d-7f04-4b66-a9b4-d481fa56b617_ext_6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2/3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2_expert_report_file_70626719-7a78-43ad-9392-0f5e4013b821.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003748540-01982276-004.pdf',
 'color': 'ORANGE',
 'currency': 'GBP',
 'engine': '1.0L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'RA18MUU',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FORD/ECOSPORT?id=3748540',
 'listing': 'auction',
 'location': 'Northampton',
 'make': 'FORD',
 'model': 'ECOSPORT',
 'odometer': 72041,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2/3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 243733,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5c587f9d-7f04-4b66-a9b4-d481fa56b617_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2/3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 243733,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5c587f9d-7f04-4b66-a9b4-d481fa56b617_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2/3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 266451,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5c587f9d-7f04-4b66-a9b4-d481fa56b617_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2/3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 197588,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5c587f9d-7f04-4b66-a9b4-d481fa56b617_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2/3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 231560,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5c587f9d-7f04-4b66-a9b4-d481fa56b617_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2/3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 228637,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5c587f9d-7f04-4b66-a9b4-d481fa56b617_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2/3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 226800,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5c587f9d-7f04-4b66-a9b4-d481fa56b617_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2/3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 233644,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5c587f9d-7f04-4b66-a9b4-d481fa56b617_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2/3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 240802,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5c587f9d-7f04-4b66-a9b4-d481fa56b617_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2/3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 301265,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5c587f9d-7f04-4b66-a9b4-d481fa56b617_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2/3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 228455,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5c587f9d-7f04-4b66-a9b4-d481fa56b617_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2/3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 228909,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5c587f9d-7f04-4b66-a9b4-d481fa56b617_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2/3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 245745,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5c587f9d-7f04-4b66-a9b4-d481fa56b617_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2/3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 286307,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3748540-3994608-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2/3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 184820,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3748540-3994608-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2/3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 274490,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3748540-3994608-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2/3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 200943,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3748540-3994608-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2/3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 206009,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3748540-3994608-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2/3fe17f46-cbeb-5fa7-bc0c-c800cb681eb2_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 145141,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3748540-3994608-1004.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-07',
 'seller_name': 'Croyland Car Megastore',
 'title': 'FORD ECOSPORT 1.0 EcoBoost 125 ST-Line 5dr',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost 125 ST-Line 5dr',
 'year': 2018}
2025-12-04 10:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273748540%27 HTTP/1.1" 200 None
2025-12-04 10:04:55 [manheim.gb] INFO: Saving data for 3748540: {'created_time': 1764842695.751711, 'last_price_update_time': 1764842695.751725, 'auction_closing_time': 1765270800.0}
2025-12-04 10:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3748540') HTTP/1.1" 204 0
2025-12-04 10:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3754025-4001984-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003754025-01985423-003.pdf)
2025-12-04 10:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa2c0380c-8fcb-4c4f-bcd1-df151e486a86_11.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a2c0380c-8fcb-4c4f-bcd1-df151e486a86_11.jpg not downloaded yet
2025-12-04 10:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a2c0380c-8fcb-4c4f-bcd1-df151e486a86_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003751763-01954244-003.pdf)
2025-12-04 10:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a2c0380c-8fcb-4c4f-bcd1-df151e486a86_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003751763-01954244-003.pdf)
2025-12-04 10:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a2d35aa7-42b9-4382-922d-24fbd17f43e6_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003754025-01985423-003.pdf)
2025-12-04 10:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa2c0380c-8fcb-4c4f-bcd1-df151e486a86_10.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a2c0380c-8fcb-4c4f-bcd1-df151e486a86_10.jpg not downloaded yet
2025-12-04 10:04:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:04:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:04:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:04:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc806550>
2025-12-04 10:04:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:04:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:04:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9/7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9_image_12.jpg HTTP/1.1" 201 0
2025-12-04 10:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa2d35aa7-42b9-4382-922d-24fbd17f43e6_ext_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a2d35aa7-42b9-4382-922d-24fbd17f43e6_ext_4.jpg saved to cache
2025-12-04 10:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9
2025-12-04 10:04:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:04:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:04:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:04:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd83510>
2025-12-04 10:04:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:04:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:04:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db5cc1b6-171e-522d-9cb0-60610e43d78f/db5cc1b6-171e-522d-9cb0-60610e43d78f_image_0.jpg HTTP/1.1" 201 0
2025-12-04 10:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa2c0380c-8fcb-4c4f-bcd1-df151e486a86_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a2c0380c-8fcb-4c4f-bcd1-df151e486a86_ext_7.jpg saved to cache
2025-12-04 10:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item db5cc1b6-171e-522d-9cb0-60610e43d78f
2025-12-04 10:04:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:04:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:04:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:04:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd4b790>
2025-12-04 10:04:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:04:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:04:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9/7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9_image_10.jpg HTTP/1.1" 201 0
2025-12-04 10:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa2d35aa7-42b9-4382-922d-24fbd17f43e6_ext_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a2d35aa7-42b9-4382-922d-24fbd17f43e6_ext_5.jpg saved to cache
2025-12-04 10:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9
2025-12-04 10:04:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:04:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:04:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:04:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc695590>
2025-12-04 10:04:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:04:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:04:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9/7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9_image_11.jpg HTTP/1.1" 201 0
2025-12-04 10:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa2d35aa7-42b9-4382-922d-24fbd17f43e6_ext_3.jpg') HTTP/1.1" 204 0
2025-12-04 10:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a2d35aa7-42b9-4382-922d-24fbd17f43e6_ext_3.jpg saved to cache
2025-12-04 10:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9
2025-12-04 10:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a2c0380c-8fcb-4c4f-bcd1-df151e486a86_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003751763-01954244-003.pdf)
2025-12-04 10:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a2d35aa7-42b9-4382-922d-24fbd17f43e6_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003754025-01985423-003.pdf)
2025-12-04 10:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa2c0380c-8fcb-4c4f-bcd1-df151e486a86_9.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a2c0380c-8fcb-4c4f-bcd1-df151e486a86_9.jpg not downloaded yet
2025-12-04 10:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa2c0380c-8fcb-4c4f-bcd1-df151e486a86_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a2c0380c-8fcb-4c4f-bcd1-df151e486a86_ext_2.jpg not downloaded yet
2025-12-04 10:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a2c0380c-8fcb-4c4f-bcd1-df151e486a86_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003751763-01954244-003.pdf)
2025-12-04 10:04:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:04:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:04:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:04:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc72ca90>
2025-12-04 10:04:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:04:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:04:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9/7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9_image_13.jpg HTTP/1.1" 201 0
2025-12-04 10:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3754025-4001984-13.jpg') HTTP/1.1" 204 0
2025-12-04 10:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3754025-4001984-13.jpg saved to cache
2025-12-04 10:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9
2025-12-04 10:04:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:04:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:04:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:04:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5cd3d0>
2025-12-04 10:04:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:04:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:04:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db5cc1b6-171e-522d-9cb0-60610e43d78f/db5cc1b6-171e-522d-9cb0-60610e43d78f_image_1.jpg HTTP/1.1" 201 0
2025-12-04 10:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa2c0380c-8fcb-4c4f-bcd1-df151e486a86_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a2c0380c-8fcb-4c4f-bcd1-df151e486a86_ext_7.jpg saved to cache
2025-12-04 10:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item db5cc1b6-171e-522d-9cb0-60610e43d78f
2025-12-04 10:04:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:04:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:04:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:04:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd02ad10>
2025-12-04 10:04:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:04:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:04:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db5cc1b6-171e-522d-9cb0-60610e43d78f/db5cc1b6-171e-522d-9cb0-60610e43d78f_image_3.jpg HTTP/1.1" 201 0
2025-12-04 10:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa2c0380c-8fcb-4c4f-bcd1-df151e486a86_ext_1.jpg') HTTP/1.1" 204 0
2025-12-04 10:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a2c0380c-8fcb-4c4f-bcd1-df151e486a86_ext_1.jpg saved to cache
2025-12-04 10:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item db5cc1b6-171e-522d-9cb0-60610e43d78f
2025-12-04 10:04:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:04:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:04:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:04:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5be750>
2025-12-04 10:04:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:04:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:04:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9/7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9_image_6.jpg HTTP/1.1" 201 0
2025-12-04 10:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa2d35aa7-42b9-4382-922d-24fbd17f43e6_11.jpg') HTTP/1.1" 204 0
2025-12-04 10:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a2d35aa7-42b9-4382-922d-24fbd17f43e6_11.jpg saved to cache
2025-12-04 10:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9
2025-12-04 10:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa2c0380c-8fcb-4c4f-bcd1-df151e486a86_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a2c0380c-8fcb-4c4f-bcd1-df151e486a86_ext_5.jpg not downloaded yet
2025-12-04 10:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa2c0380c-8fcb-4c4f-bcd1-df151e486a86_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a2c0380c-8fcb-4c4f-bcd1-df151e486a86_ext_3.jpg not downloaded yet
2025-12-04 10:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a2d35aa7-42b9-4382-922d-24fbd17f43e6_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003754025-01985423-003.pdf)
2025-12-04 10:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a2c0380c-8fcb-4c4f-bcd1-df151e486a86_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003751763-01954244-003.pdf)
2025-12-04 10:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a2c0380c-8fcb-4c4f-bcd1-df151e486a86_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003751763-01954244-003.pdf)
2025-12-04 10:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a2c0380c-8fcb-4c4f-bcd1-df151e486a86_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003751763-01954244-003.pdf)
2025-12-04 10:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa2c0380c-8fcb-4c4f-bcd1-df151e486a86_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a2c0380c-8fcb-4c4f-bcd1-df151e486a86_ext_4.jpg not downloaded yet
2025-12-04 10:04:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:04:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:04:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:04:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc7c9450>
2025-12-04 10:04:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:04:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:04:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db5cc1b6-171e-522d-9cb0-60610e43d78f/db5cc1b6-171e-522d-9cb0-60610e43d78f_image_2.jpg HTTP/1.1" 201 0
2025-12-04 10:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa2c0380c-8fcb-4c4f-bcd1-df151e486a86_ext_6.jpg') HTTP/1.1" 204 0
2025-12-04 10:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a2c0380c-8fcb-4c4f-bcd1-df151e486a86_ext_6.jpg saved to cache
2025-12-04 10:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item db5cc1b6-171e-522d-9cb0-60610e43d78f
2025-12-04 10:04:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:04:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:04:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:04:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cccfd010>
2025-12-04 10:04:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:04:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:04:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9/7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9_image_9.jpg HTTP/1.1" 201 0
2025-12-04 10:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa2d35aa7-42b9-4382-922d-24fbd17f43e6_ext_2.jpg') HTTP/1.1" 204 0
2025-12-04 10:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a2d35aa7-42b9-4382-922d-24fbd17f43e6_ext_2.jpg saved to cache
2025-12-04 10:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9
2025-12-04 10:04:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:04:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:04:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:04:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccca7c50>
2025-12-04 10:04:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:04:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:04:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db5cc1b6-171e-522d-9cb0-60610e43d78f/db5cc1b6-171e-522d-9cb0-60610e43d78f_image_5.jpg HTTP/1.1" 201 0
2025-12-04 10:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa2c0380c-8fcb-4c4f-bcd1-df151e486a86_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a2c0380c-8fcb-4c4f-bcd1-df151e486a86_4.jpg saved to cache
2025-12-04 10:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item db5cc1b6-171e-522d-9cb0-60610e43d78f
2025-12-04 10:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3751763-3969594-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3751763-3969594-13.jpg not downloaded yet
2025-12-04 10:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3751763-3969594-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3751763-3969594-1000.jpg not downloaded yet
2025-12-04 10:04:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a2c0380c-8fcb-4c4f-bcd1-df151e486a86_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003751763-01954244-003.pdf)
2025-12-04 10:04:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:04:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:04:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:04:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc567e90>
2025-12-04 10:04:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:04:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:04:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:04:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9/7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9_image_5.jpg HTTP/1.1" 201 0
2025-12-04 10:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa2d35aa7-42b9-4382-922d-24fbd17f43e6_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a2d35aa7-42b9-4382-922d-24fbd17f43e6_4.jpg saved to cache
2025-12-04 10:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9
2025-12-04 10:04:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:04:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:04:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:04:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd75190>
2025-12-04 10:04:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:04:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:04:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:04:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:04:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db5cc1b6-171e-522d-9cb0-60610e43d78f/db5cc1b6-171e-522d-9cb0-60610e43d78f_image_6.jpg HTTP/1.1" 201 0
2025-12-04 10:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa2c0380c-8fcb-4c4f-bcd1-df151e486a86_11.jpg') HTTP/1.1" 204 0
2025-12-04 10:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a2c0380c-8fcb-4c4f-bcd1-df151e486a86_11.jpg saved to cache
2025-12-04 10:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item db5cc1b6-171e-522d-9cb0-60610e43d78f
2025-12-04 10:04:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:04:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:04:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:04:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc71bb10>
2025-12-04 10:04:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:04:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:04:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:04:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:04:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db5cc1b6-171e-522d-9cb0-60610e43d78f/db5cc1b6-171e-522d-9cb0-60610e43d78f_image_4.jpg HTTP/1.1" 201 0
2025-12-04 10:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa2c0380c-8fcb-4c4f-bcd1-df151e486a86_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a2c0380c-8fcb-4c4f-bcd1-df151e486a86_5.jpg saved to cache
2025-12-04 10:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item db5cc1b6-171e-522d-9cb0-60610e43d78f
2025-12-04 10:04:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:04:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:04:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:04:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc611fd0>
2025-12-04 10:04:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:04:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:04:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:04:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:04:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db5cc1b6-171e-522d-9cb0-60610e43d78f/db5cc1b6-171e-522d-9cb0-60610e43d78f_image_7.jpg HTTP/1.1" 201 0
2025-12-04 10:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa2c0380c-8fcb-4c4f-bcd1-df151e486a86_10.jpg') HTTP/1.1" 204 0
2025-12-04 10:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a2c0380c-8fcb-4c4f-bcd1-df151e486a86_10.jpg saved to cache
2025-12-04 10:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item db5cc1b6-171e-522d-9cb0-60610e43d78f
2025-12-04 10:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3751763-3969594-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3751763-3969594-1001.jpg not downloaded yet
2025-12-04 10:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3751763-3969594-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3751763-3969594-1002.jpg not downloaded yet
2025-12-04 10:04:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:04:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:04:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:04:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd061910>
2025-12-04 10:04:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:04:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db5cc1b6-171e-522d-9cb0-60610e43d78f/db5cc1b6-171e-522d-9cb0-60610e43d78f_image_8.jpg HTTP/1.1" 201 0
2025-12-04 10:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa2c0380c-8fcb-4c4f-bcd1-df151e486a86_9.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a2c0380c-8fcb-4c4f-bcd1-df151e486a86_9.jpg saved to cache
2025-12-04 10:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item db5cc1b6-171e-522d-9cb0-60610e43d78f
2025-12-04 10:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a2d35aa7-42b9-4382-922d-24fbd17f43e6_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003754025-01985423-003.pdf)
2025-12-04 10:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a2c0380c-8fcb-4c4f-bcd1-df151e486a86_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003751763-01954244-003.pdf)
2025-12-04 10:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a2c0380c-8fcb-4c4f-bcd1-df151e486a86_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003751763-01954244-003.pdf)
2025-12-04 10:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a2c0380c-8fcb-4c4f-bcd1-df151e486a86_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003751763-01954244-003.pdf)
2025-12-04 10:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3751763-3969594-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3751763-3969594-1003.jpg not downloaded yet
2025-12-04 10:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3751763-3969594-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3751763-3969594-1004.jpg not downloaded yet
2025-12-04 10:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3751763-3969594-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3751763-3969594-1005.jpg not downloaded yet
2025-12-04 10:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003740756-01978016-001.pdf> (referer: None)
2025-12-04 10:05:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc710d10>
2025-12-04 10:05:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 10:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9/7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9_image_4.jpg HTTP/1.1" 201 0
2025-12-04 10:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa2d35aa7-42b9-4382-922d-24fbd17f43e6_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a2d35aa7-42b9-4382-922d-24fbd17f43e6_5.jpg saved to cache
2025-12-04 10:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9
2025-12-04 10:05:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce50250>
2025-12-04 10:05:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db5cc1b6-171e-522d-9cb0-60610e43d78f/db5cc1b6-171e-522d-9cb0-60610e43d78f_image_10.jpg HTTP/1.1" 201 0
2025-12-04 10:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa2c0380c-8fcb-4c4f-bcd1-df151e486a86_ext_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a2c0380c-8fcb-4c4f-bcd1-df151e486a86_ext_5.jpg saved to cache
2025-12-04 10:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item db5cc1b6-171e-522d-9cb0-60610e43d78f
2025-12-04 10:05:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5702d0>
2025-12-04 10:05:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:05:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db5cc1b6-171e-522d-9cb0-60610e43d78f/db5cc1b6-171e-522d-9cb0-60610e43d78f_image_9.jpg HTTP/1.1" 201 0
2025-12-04 10:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa2c0380c-8fcb-4c4f-bcd1-df151e486a86_ext_2.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a2c0380c-8fcb-4c4f-bcd1-df151e486a86_ext_2.jpg saved to cache
2025-12-04 10:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item db5cc1b6-171e-522d-9cb0-60610e43d78f
2025-12-04 10:05:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc573250>
2025-12-04 10:05:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:05:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db5cc1b6-171e-522d-9cb0-60610e43d78f/db5cc1b6-171e-522d-9cb0-60610e43d78f_image_11.jpg HTTP/1.1" 201 0
2025-12-04 10:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa2c0380c-8fcb-4c4f-bcd1-df151e486a86_ext_3.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a2c0380c-8fcb-4c4f-bcd1-df151e486a86_ext_3.jpg saved to cache
2025-12-04 10:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item db5cc1b6-171e-522d-9cb0-60610e43d78f
2025-12-04 10:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3751763-3969594-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003751763-01954244-003.pdf)
2025-12-04 10:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3751763-3969594-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003751763-01954244-003.pdf)
2025-12-04 10:05:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6720d0>
2025-12-04 10:05:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:05:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27c40b73-4217-5525-8def-8f7189d22661/27c40b73-4217-5525-8def-8f7189d22661_expert_report_file_90fc2d2e-2130-4e65-a7f0-6f574274eef8.pdf HTTP/1.1" 201 0
2025-12-04 10:05:01 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 27c40b73-4217-5525-8def-8f7189d22661
2025-12-04 10:05:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 27c40b73-4217-5525-8def-8f7189d22661, skipping ID generation
2025-12-04 10:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 27c40b73-4217-5525-8def-8f7189d22661
2025-12-04 10:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F344b9b73-5087-49b0-835a-3de2e774a198_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/344b9b73-5087-49b0-835a-3de2e774a198_ext_7.jpg not downloaded yet
2025-12-04 10:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a2c0380c-8fcb-4c4f-bcd1-df151e486a86_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003751763-01954244-003.pdf)
2025-12-04 10:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3751763-3969594-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003751763-01954244-003.pdf)
2025-12-04 10:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3751763-3969594-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003751763-01954244-003.pdf)
2025-12-04 10:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F344b9b73-5087-49b0-835a-3de2e774a198_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/344b9b73-5087-49b0-835a-3de2e774a198_ext_7.jpg not downloaded yet
2025-12-04 10:05:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd13650>
2025-12-04 10:05:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db5cc1b6-171e-522d-9cb0-60610e43d78f/db5cc1b6-171e-522d-9cb0-60610e43d78f_image_15.jpg HTTP/1.1" 201 0
2025-12-04 10:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3751763-3969594-1001.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3751763-3969594-1001.jpg saved to cache
2025-12-04 10:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item db5cc1b6-171e-522d-9cb0-60610e43d78f
2025-12-04 10:05:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cced8e50>
2025-12-04 10:05:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db5cc1b6-171e-522d-9cb0-60610e43d78f/db5cc1b6-171e-522d-9cb0-60610e43d78f_image_13.jpg HTTP/1.1" 201 0
2025-12-04 10:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3751763-3969594-13.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3751763-3969594-13.jpg saved to cache
2025-12-04 10:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item db5cc1b6-171e-522d-9cb0-60610e43d78f
2025-12-04 10:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3751763-3969594-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003751763-01954244-003.pdf)
2025-12-04 10:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3751763-3969594-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003751763-01954244-003.pdf)
2025-12-04 10:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F344b9b73-5087-49b0-835a-3de2e774a198_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/344b9b73-5087-49b0-835a-3de2e774a198_ext_6.jpg not downloaded yet
2025-12-04 10:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F344b9b73-5087-49b0-835a-3de2e774a198_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/344b9b73-5087-49b0-835a-3de2e774a198_ext_1.jpg not downloaded yet
2025-12-04 10:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a2d35aa7-42b9-4382-922d-24fbd17f43e6_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003754025-01985423-003.pdf)
2025-12-04 10:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3751763-3969594-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003751763-01954244-003.pdf)
2025-12-04 10:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a2d35aa7-42b9-4382-922d-24fbd17f43e6_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003754025-01985423-003.pdf)
2025-12-04 10:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F344b9b73-5087-49b0-835a-3de2e774a198_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/344b9b73-5087-49b0-835a-3de2e774a198_5.jpg not downloaded yet
2025-12-04 10:05:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5cf7d0>
2025-12-04 10:05:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db5cc1b6-171e-522d-9cb0-60610e43d78f/db5cc1b6-171e-522d-9cb0-60610e43d78f_image_12.jpg HTTP/1.1" 201 0
2025-12-04 10:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa2c0380c-8fcb-4c4f-bcd1-df151e486a86_ext_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a2c0380c-8fcb-4c4f-bcd1-df151e486a86_ext_4.jpg saved to cache
2025-12-04 10:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item db5cc1b6-171e-522d-9cb0-60610e43d78f
2025-12-04 10:05:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccfce850>
2025-12-04 10:05:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db5cc1b6-171e-522d-9cb0-60610e43d78f/db5cc1b6-171e-522d-9cb0-60610e43d78f_image_14.jpg HTTP/1.1" 201 0
2025-12-04 10:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3751763-3969594-1000.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3751763-3969594-1000.jpg saved to cache
2025-12-04 10:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item db5cc1b6-171e-522d-9cb0-60610e43d78f
2025-12-04 10:05:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc7e5210>
2025-12-04 10:05:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db5cc1b6-171e-522d-9cb0-60610e43d78f/db5cc1b6-171e-522d-9cb0-60610e43d78f_image_16.jpg HTTP/1.1" 201 0
2025-12-04 10:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3751763-3969594-1002.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3751763-3969594-1002.jpg saved to cache
2025-12-04 10:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item db5cc1b6-171e-522d-9cb0-60610e43d78f
2025-12-04 10:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/dbdb3c14-3fe2-450a-98a7-33597d0542ed_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003752426-01969136-004.pdf)
2025-12-04 10:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F344b9b73-5087-49b0-835a-3de2e774a198_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/344b9b73-5087-49b0-835a-3de2e774a198_4.jpg not downloaded yet
2025-12-04 10:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F344b9b73-5087-49b0-835a-3de2e774a198_11.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/344b9b73-5087-49b0-835a-3de2e774a198_11.jpg not downloaded yet
2025-12-04 10:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/344b9b73-5087-49b0-835a-3de2e774a198_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003740756-01978016-001.pdf)
2025-12-04 10:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/344b9b73-5087-49b0-835a-3de2e774a198_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003740756-01978016-001.pdf)
2025-12-04 10:05:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd9bbd0>
2025-12-04 10:05:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db5cc1b6-171e-522d-9cb0-60610e43d78f/db5cc1b6-171e-522d-9cb0-60610e43d78f_image_19.jpg HTTP/1.1" 201 0
2025-12-04 10:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3751763-3969594-1005.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3751763-3969594-1005.jpg saved to cache
2025-12-04 10:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item db5cc1b6-171e-522d-9cb0-60610e43d78f
2025-12-04 10:05:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cccec950>
2025-12-04 10:05:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db5cc1b6-171e-522d-9cb0-60610e43d78f/db5cc1b6-171e-522d-9cb0-60610e43d78f_image_18.jpg HTTP/1.1" 201 0
2025-12-04 10:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3751763-3969594-1004.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3751763-3969594-1004.jpg saved to cache
2025-12-04 10:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item db5cc1b6-171e-522d-9cb0-60610e43d78f
2025-12-04 10:05:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf6a0d0>
2025-12-04 10:05:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9/7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9_image_3.jpg HTTP/1.1" 201 0
2025-12-04 10:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa2d35aa7-42b9-4382-922d-24fbd17f43e6_ext_1.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a2d35aa7-42b9-4382-922d-24fbd17f43e6_ext_1.jpg saved to cache
2025-12-04 10:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9
2025-12-04 10:05:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccced350>
2025-12-04 10:05:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db5cc1b6-171e-522d-9cb0-60610e43d78f/db5cc1b6-171e-522d-9cb0-60610e43d78f_image_17.jpg HTTP/1.1" 201 0
2025-12-04 10:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3751763-3969594-1003.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3751763-3969594-1003.jpg saved to cache
2025-12-04 10:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item db5cc1b6-171e-522d-9cb0-60610e43d78f
2025-12-04 10:05:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: db5cc1b6-171e-522d-9cb0-60610e43d78f, skipping ID generation
2025-12-04 10:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Removing item db5cc1b6-171e-522d-9cb0-60610e43d78f from tracking dictionaries
2025-12-04 10:05:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item db5cc1b6-171e-522d-9cb0-60610e43d78f sending to next pipeline
2025-12-04 10:05:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: db5cc1b6-171e-522d-9cb0-60610e43d78f, identifier: 3751763
2025-12-04 10:05:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd22b690>
2025-12-04 10:05:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9/7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9_image_2.jpg HTTP/1.1" 201 0
2025-12-04 10:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa2d35aa7-42b9-4382-922d-24fbd17f43e6_ext_6.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a2d35aa7-42b9-4382-922d-24fbd17f43e6_ext_6.jpg saved to cache
2025-12-04 10:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9
2025-12-04 10:05:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9, skipping ID generation
2025-12-04 10:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9 from tracking dictionaries
2025-12-04 10:05:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9 sending to next pipeline
2025-12-04 10:05:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9, identifier: 3754025
2025-12-04 10:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F344b9b73-5087-49b0-835a-3de2e774a198_10.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/344b9b73-5087-49b0-835a-3de2e774a198_10.jpg not downloaded yet
2025-12-04 10:05:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: db5cc1b6-171e-522d-9cb0-60610e43d78f with identifier: 3751763
2025-12-04 10:05:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: db5cc1b6-171e-522d-9cb0-60610e43d78f with identifier: 3751763
2025-12-04 10:05:05 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: db5cc1b6-171e-522d-9cb0-60610e43d78f with identifier: 3751763 to the API
2025-12-04 10:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 10:05:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 10:05:05 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/insp-0001-3751763-3969594-1003.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 166,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db5cc1b6-171e-522d-9cb0-60610e43d78f/db5cc1b6-171e-522d-9cb0-60610e43d78f_expert_report_file_894c783b-7d41-4756-8fff-490060469196.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003751763-01954244-003.pdf',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Petrol/Hybrid',
 'id': 'db5cc1b6-171e-522d-9cb0-60610e43d78f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'FN72OER',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/KIA/SORENTO?id=3751763',
 'listing': 'auction',
 'location': 'Bristol',
 'make': 'KIA',
 'model': 'SORENTO',
 'odometer': 54048,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 49,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db5cc1b6-171e-522d-9cb0-60610e43d78f/db5cc1b6-171e-522d-9cb0-60610e43d78f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 230416,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a2c0380c-8fcb-4c4f-bcd1-df151e486a86_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db5cc1b6-171e-522d-9cb0-60610e43d78f/db5cc1b6-171e-522d-9cb0-60610e43d78f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 230416,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a2c0380c-8fcb-4c4f-bcd1-df151e486a86_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db5cc1b6-171e-522d-9cb0-60610e43d78f/db5cc1b6-171e-522d-9cb0-60610e43d78f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 226956,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a2c0380c-8fcb-4c4f-bcd1-df151e486a86_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db5cc1b6-171e-522d-9cb0-60610e43d78f/db5cc1b6-171e-522d-9cb0-60610e43d78f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 144705,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a2c0380c-8fcb-4c4f-bcd1-df151e486a86_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db5cc1b6-171e-522d-9cb0-60610e43d78f/db5cc1b6-171e-522d-9cb0-60610e43d78f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 225657,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a2c0380c-8fcb-4c4f-bcd1-df151e486a86_5.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db5cc1b6-171e-522d-9cb0-60610e43d78f/db5cc1b6-171e-522d-9cb0-60610e43d78f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 217556,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a2c0380c-8fcb-4c4f-bcd1-df151e486a86_4.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db5cc1b6-171e-522d-9cb0-60610e43d78f/db5cc1b6-171e-522d-9cb0-60610e43d78f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 235422,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a2c0380c-8fcb-4c4f-bcd1-df151e486a86_11.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db5cc1b6-171e-522d-9cb0-60610e43d78f/db5cc1b6-171e-522d-9cb0-60610e43d78f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 202884,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a2c0380c-8fcb-4c4f-bcd1-df151e486a86_10.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db5cc1b6-171e-522d-9cb0-60610e43d78f/db5cc1b6-171e-522d-9cb0-60610e43d78f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 230262,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a2c0380c-8fcb-4c4f-bcd1-df151e486a86_9.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db5cc1b6-171e-522d-9cb0-60610e43d78f/db5cc1b6-171e-522d-9cb0-60610e43d78f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 251640,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a2c0380c-8fcb-4c4f-bcd1-df151e486a86_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db5cc1b6-171e-522d-9cb0-60610e43d78f/db5cc1b6-171e-522d-9cb0-60610e43d78f_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 213550,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a2c0380c-8fcb-4c4f-bcd1-df151e486a86_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db5cc1b6-171e-522d-9cb0-60610e43d78f/db5cc1b6-171e-522d-9cb0-60610e43d78f_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 253865,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a2c0380c-8fcb-4c4f-bcd1-df151e486a86_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db5cc1b6-171e-522d-9cb0-60610e43d78f/db5cc1b6-171e-522d-9cb0-60610e43d78f_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 214941,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a2c0380c-8fcb-4c4f-bcd1-df151e486a86_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db5cc1b6-171e-522d-9cb0-60610e43d78f/db5cc1b6-171e-522d-9cb0-60610e43d78f_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 245960,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3751763-3969594-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db5cc1b6-171e-522d-9cb0-60610e43d78f/db5cc1b6-171e-522d-9cb0-60610e43d78f_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 222425,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3751763-3969594-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db5cc1b6-171e-522d-9cb0-60610e43d78f/db5cc1b6-171e-522d-9cb0-60610e43d78f_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116393,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3751763-3969594-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db5cc1b6-171e-522d-9cb0-60610e43d78f/db5cc1b6-171e-522d-9cb0-60610e43d78f_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 259555,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3751763-3969594-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db5cc1b6-171e-522d-9cb0-60610e43d78f/db5cc1b6-171e-522d-9cb0-60610e43d78f_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 205602,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3751763-3969594-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db5cc1b6-171e-522d-9cb0-60610e43d78f/db5cc1b6-171e-522d-9cb0-60610e43d78f_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 137691,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3751763-3969594-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db5cc1b6-171e-522d-9cb0-60610e43d78f/db5cc1b6-171e-522d-9cb0-60610e43d78f_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 287650,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3751763-3969594-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-13',
 'seller_name': 'Leasys',
 'title': 'KIA SORENTO 1.6 T-GDi HEV 3 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.6 T-GDi HEV 3 5dr Auto',
 'year': 2022}
2025-12-04 10:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273751763%27 HTTP/1.1" 200 None
2025-12-04 10:05:05 [manheim.gb] INFO: Saving data for 3751763: {'created_time': 1764842705.960736, 'last_price_update_time': 1764842705.960747, 'auction_closing_time': 1765270800.0}
2025-12-04 10:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3751763') HTTP/1.1" 204 0
2025-12-04 10:05:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9 with identifier: 3754025
2025-12-04 10:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-04 10:05:06 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=BLUE HTTP/1.1" 200 None
2025-12-04 10:05:06 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-04 10:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-04 10:05:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9 with identifier: 3754025
2025-12-04 10:05:06 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9 with identifier: 3754025 to the API
2025-12-04 10:05:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 10:05:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 10:05:07 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/a2d35aa7-42b9-4382-922d-24fbd17f43e6_ext_6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9/7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9_expert_report_file_1b153a81-fe7f-4d3d-8b5b-89a430b0c7b2.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003754025-01985423-003.pdf',
 'color': 'BLUE',
 'currency': 'GBP',
 'engine': '1.5L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'YR21TXJ',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FORD/KUGA?id=3754025',
 'listing': 'auction',
 'location': 'Bristol',
 'make': 'FORD',
 'model': 'KUGA',
 'odometer': 44458,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 33,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9/7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 210785,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a2d35aa7-42b9-4382-922d-24fbd17f43e6_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9/7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 210785,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a2d35aa7-42b9-4382-922d-24fbd17f43e6_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9/7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 234240,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a2d35aa7-42b9-4382-922d-24fbd17f43e6_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9/7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 175232,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a2d35aa7-42b9-4382-922d-24fbd17f43e6_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9/7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 182430,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a2d35aa7-42b9-4382-922d-24fbd17f43e6_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9/7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 195319,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a2d35aa7-42b9-4382-922d-24fbd17f43e6_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9/7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 184818,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a2d35aa7-42b9-4382-922d-24fbd17f43e6_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9/7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 181102,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a2d35aa7-42b9-4382-922d-24fbd17f43e6_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9/7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 206983,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a2d35aa7-42b9-4382-922d-24fbd17f43e6_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9/7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 239672,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a2d35aa7-42b9-4382-922d-24fbd17f43e6_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9/7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 220942,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a2d35aa7-42b9-4382-922d-24fbd17f43e6_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9/7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 243473,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a2d35aa7-42b9-4382-922d-24fbd17f43e6_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9/7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 189570,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a2d35aa7-42b9-4382-922d-24fbd17f43e6_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9/7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 383202,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3754025-4001984-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9/7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 338921,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3754025-4001984-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9/7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 333221,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3754025-4001984-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9/7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 326043,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3754025-4001984-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9/7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 292981,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3754025-4001984-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9/7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 235378,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3754025-4001984-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9/7b087137-8ed7-5ebf-b2f7-e355dfc6c1b9_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 563119,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3754025-4001984-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-18',
 'seller_name': 'Novuna Vehicle Solutions',
 'title': 'FORD KUGA 1.5 EcoBlue ST-Line X Edition 5dr',
 'transmission': 'manual',
 'trim': '1.5 EcoBlue ST-Line X Edition 5dr',
 'year': 2021}
2025-12-04 10:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273754025%27 HTTP/1.1" 200 None
2025-12-04 10:05:07 [manheim.gb] INFO: Saving data for 3754025: {'created_time': 1764842707.049708, 'last_price_update_time': 1764842707.049717, 'auction_closing_time': 1765270800.0}
2025-12-04 10:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3754025') HTTP/1.1" 204 0
2025-12-04 10:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F344b9b73-5087-49b0-835a-3de2e774a198_9.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/344b9b73-5087-49b0-835a-3de2e774a198_9.jpg not downloaded yet
2025-12-04 10:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/TESLA/MODEL?id=3737837&returnUrl=%2Fsearch%3FPage%3D4%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233737837&indx=362> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 10:05:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5f6490>
2025-12-04 10:05:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07a43b40-c094-5b22-b61d-8f11e55e71c0/07a43b40-c094-5b22-b61d-8f11e55e71c0_image_10.jpg HTTP/1.1" 201 0
2025-12-04 10:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdbdb3c14-3fe2-450a-98a7-33597d0542ed_ext_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dbdb3c14-3fe2-450a-98a7-33597d0542ed_ext_5.jpg saved to cache
2025-12-04 10:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 07a43b40-c094-5b22-b61d-8f11e55e71c0
2025-12-04 10:05:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc7dc690>
2025-12-04 10:05:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27c40b73-4217-5525-8def-8f7189d22661/27c40b73-4217-5525-8def-8f7189d22661_image_1.jpg HTTP/1.1" 201 0
2025-12-04 10:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F344b9b73-5087-49b0-835a-3de2e774a198_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/344b9b73-5087-49b0-835a-3de2e774a198_ext_7.jpg saved to cache
2025-12-04 10:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 27c40b73-4217-5525-8def-8f7189d22661
2025-12-04 10:05:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cced9410>
2025-12-04 10:05:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27c40b73-4217-5525-8def-8f7189d22661/27c40b73-4217-5525-8def-8f7189d22661_image_0.jpg HTTP/1.1" 201 0
2025-12-04 10:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F344b9b73-5087-49b0-835a-3de2e774a198_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/344b9b73-5087-49b0-835a-3de2e774a198_ext_7.jpg saved to cache
2025-12-04 10:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 27c40b73-4217-5525-8def-8f7189d22661
2025-12-04 10:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/344b9b73-5087-49b0-835a-3de2e774a198_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003740756-01978016-001.pdf)
2025-12-04 10:05:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 10:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/CITROEN/C3?id=3737761&returnUrl=%2Fsearch%3FPage%3D4%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233737761&indx=360> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 10:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/344b9b73-5087-49b0-835a-3de2e774a198_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003740756-01978016-001.pdf)
2025-12-04 10:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F344b9b73-5087-49b0-835a-3de2e774a198_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/344b9b73-5087-49b0-835a-3de2e774a198_ext_2.jpg not downloaded yet
2025-12-04 10:05:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 10:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/dbdb3c14-3fe2-450a-98a7-33597d0542ed_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003752426-01969136-004.pdf)
2025-12-04 10:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/344b9b73-5087-49b0-835a-3de2e774a198_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003740756-01978016-001.pdf)
2025-12-04 10:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/dbdb3c14-3fe2-450a-98a7-33597d0542ed_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003752426-01969136-004.pdf)
2025-12-04 10:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/344b9b73-5087-49b0-835a-3de2e774a198_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003740756-01978016-001.pdf)
2025-12-04 10:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/MINI/COUNTRYMAN?id=3737655&returnUrl=%2Fsearch%3FPage%3D4%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233737655&indx=359> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 10:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F344b9b73-5087-49b0-835a-3de2e774a198_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/344b9b73-5087-49b0-835a-3de2e774a198_ext_5.jpg not downloaded yet
2025-12-04 10:05:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cbf6a261-72e5-58f4-adf3-e63bfe23c322 with identifier: 3737837
2025-12-04 10:05:07 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item cbf6a261-72e5-58f4-adf3-e63bfe23c322
2025-12-04 10:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F344b9b73-5087-49b0-835a-3de2e774a198_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/344b9b73-5087-49b0-835a-3de2e774a198_ext_3.jpg not downloaded yet
2025-12-04 10:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F344b9b73-5087-49b0-835a-3de2e774a198_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/344b9b73-5087-49b0-835a-3de2e774a198_ext_4.jpg not downloaded yet
2025-12-04 10:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/LAND%20ROVER/RANGEROVEREVOQUE?id=3737827&returnUrl=%2Fsearch%3FPage%3D4%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233737827&indx=361> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 10:05:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6e2d50>
2025-12-04 10:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27c40b73-4217-5525-8def-8f7189d22661/27c40b73-4217-5525-8def-8f7189d22661_image_4.jpg HTTP/1.1" 201 0
2025-12-04 10:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F344b9b73-5087-49b0-835a-3de2e774a198_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/344b9b73-5087-49b0-835a-3de2e774a198_5.jpg saved to cache
2025-12-04 10:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 27c40b73-4217-5525-8def-8f7189d22661
2025-12-04 10:05:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 417a6ff8-aba3-55b0-b54f-462a6dc74cf6 with identifier: 3737761
2025-12-04 10:05:08 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 417a6ff8-aba3-55b0-b54f-462a6dc74cf6
2025-12-04 10:05:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc54cbd0>
2025-12-04 10:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27c40b73-4217-5525-8def-8f7189d22661/27c40b73-4217-5525-8def-8f7189d22661_image_3.jpg HTTP/1.1" 201 0
2025-12-04 10:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F344b9b73-5087-49b0-835a-3de2e774a198_ext_1.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/344b9b73-5087-49b0-835a-3de2e774a198_ext_1.jpg saved to cache
2025-12-04 10:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 27c40b73-4217-5525-8def-8f7189d22661
2025-12-04 10:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3740756-4002138-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3740756-4002138-13.jpg not downloaded yet
2025-12-04 10:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3740756-3983360-15.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3740756-3983360-15.jpg not downloaded yet
2025-12-04 10:05:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc596190>
2025-12-04 10:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07a43b40-c094-5b22-b61d-8f11e55e71c0/07a43b40-c094-5b22-b61d-8f11e55e71c0_image_9.jpg HTTP/1.1" 201 0
2025-12-04 10:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdbdb3c14-3fe2-450a-98a7-33597d0542ed_ext_2.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dbdb3c14-3fe2-450a-98a7-33597d0542ed_ext_2.jpg saved to cache
2025-12-04 10:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 07a43b40-c094-5b22-b61d-8f11e55e71c0
2025-12-04 10:05:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd008250>
2025-12-04 10:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27c40b73-4217-5525-8def-8f7189d22661/27c40b73-4217-5525-8def-8f7189d22661_image_2.jpg HTTP/1.1" 201 0
2025-12-04 10:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F344b9b73-5087-49b0-835a-3de2e774a198_ext_6.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/344b9b73-5087-49b0-835a-3de2e774a198_ext_6.jpg saved to cache
2025-12-04 10:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 27c40b73-4217-5525-8def-8f7189d22661
2025-12-04 10:05:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc56c650>
2025-12-04 10:05:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07a43b40-c094-5b22-b61d-8f11e55e71c0/07a43b40-c094-5b22-b61d-8f11e55e71c0_image_8.jpg HTTP/1.1" 201 0
2025-12-04 10:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdbdb3c14-3fe2-450a-98a7-33597d0542ed_9.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dbdb3c14-3fe2-450a-98a7-33597d0542ed_9.jpg saved to cache
2025-12-04 10:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 07a43b40-c094-5b22-b61d-8f11e55e71c0
2025-12-04 10:05:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc597650>
2025-12-04 10:05:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27c40b73-4217-5525-8def-8f7189d22661/27c40b73-4217-5525-8def-8f7189d22661_image_5.jpg HTTP/1.1" 201 0
2025-12-04 10:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F344b9b73-5087-49b0-835a-3de2e774a198_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/344b9b73-5087-49b0-835a-3de2e774a198_4.jpg saved to cache
2025-12-04 10:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 27c40b73-4217-5525-8def-8f7189d22661
2025-12-04 10:05:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 823fa041-4c2f-5fa5-b851-cbe9c59b2804 with identifier: 3737655
2025-12-04 10:05:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 823fa041-4c2f-5fa5-b851-cbe9c59b2804 with scrape type 1
2025-12-04 10:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 823fa041-4c2f-5fa5-b851-cbe9c59b2804
2025-12-04 10:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737655-3988786-1.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737655-3988786-1.jpg not downloaded yet
2025-12-04 10:05:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0dbba9f9-5f80-5b85-b53c-7bfc7d08b658 with identifier: 3737827
2025-12-04 10:05:09 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 0dbba9f9-5f80-5b85-b53c-7bfc7d08b658
2025-12-04 10:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/dbdb3c14-3fe2-450a-98a7-33597d0542ed_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003752426-01969136-004.pdf)
2025-12-04 10:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/dbdb3c14-3fe2-450a-98a7-33597d0542ed_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003752426-01969136-004.pdf)
2025-12-04 10:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/dbdb3c14-3fe2-450a-98a7-33597d0542ed_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003752426-01969136-004.pdf)
2025-12-04 10:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/344b9b73-5087-49b0-835a-3de2e774a198_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003740756-01978016-001.pdf)
2025-12-04 10:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/344b9b73-5087-49b0-835a-3de2e774a198_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003740756-01978016-001.pdf)
2025-12-04 10:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/dbdb3c14-3fe2-450a-98a7-33597d0542ed_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003752426-01969136-004.pdf)
2025-12-04 10:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/344b9b73-5087-49b0-835a-3de2e774a198_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003740756-01978016-001.pdf)
2025-12-04 10:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/dbdb3c14-3fe2-450a-98a7-33597d0542ed_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003752426-01969136-004.pdf)
2025-12-04 10:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3740756-3983360-16.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3740756-3983360-16.jpg not downloaded yet
2025-12-04 10:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737655-3988786-2.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737655-3988786-2.jpg not downloaded yet
2025-12-04 10:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/BMW/3SERIES?id=3737981&returnUrl=%2Fsearch%3FPage%3D4%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233737981&indx=363> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 10:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3740756-3983360-28.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3740756-3983360-28.jpg not downloaded yet
2025-12-04 10:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737655-3988786-3.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737655-3988786-3.jpg not downloaded yet
2025-12-04 10:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3740756-3983360-39.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3740756-3983360-39.jpg not downloaded yet
2025-12-04 10:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737655-3988786-4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737655-3988786-4.jpg not downloaded yet
2025-12-04 10:05:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5f4050>
2025-12-04 10:05:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07a43b40-c094-5b22-b61d-8f11e55e71c0/07a43b40-c094-5b22-b61d-8f11e55e71c0_image_7.jpg HTTP/1.1" 201 0
2025-12-04 10:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdbdb3c14-3fe2-450a-98a7-33597d0542ed_10.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dbdb3c14-3fe2-450a-98a7-33597d0542ed_10.jpg saved to cache
2025-12-04 10:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 07a43b40-c094-5b22-b61d-8f11e55e71c0
2025-12-04 10:05:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd67710>
2025-12-04 10:05:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07a43b40-c094-5b22-b61d-8f11e55e71c0/07a43b40-c094-5b22-b61d-8f11e55e71c0_image_5.jpg HTTP/1.1" 201 0
2025-12-04 10:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdbdb3c14-3fe2-450a-98a7-33597d0542ed_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dbdb3c14-3fe2-450a-98a7-33597d0542ed_4.jpg saved to cache
2025-12-04 10:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 07a43b40-c094-5b22-b61d-8f11e55e71c0
2025-12-04 10:05:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccdf7ad0>
2025-12-04 10:05:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07a43b40-c094-5b22-b61d-8f11e55e71c0/07a43b40-c094-5b22-b61d-8f11e55e71c0_image_3.jpg HTTP/1.1" 201 0
2025-12-04 10:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdbdb3c14-3fe2-450a-98a7-33597d0542ed_ext_1.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dbdb3c14-3fe2-450a-98a7-33597d0542ed_ext_1.jpg saved to cache
2025-12-04 10:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 07a43b40-c094-5b22-b61d-8f11e55e71c0
2025-12-04 10:05:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc67f490>
2025-12-04 10:05:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27c40b73-4217-5525-8def-8f7189d22661/27c40b73-4217-5525-8def-8f7189d22661_image_6.jpg HTTP/1.1" 201 0
2025-12-04 10:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F344b9b73-5087-49b0-835a-3de2e774a198_11.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/344b9b73-5087-49b0-835a-3de2e774a198_11.jpg saved to cache
2025-12-04 10:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 27c40b73-4217-5525-8def-8f7189d22661
2025-12-04 10:05:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccdb7050>
2025-12-04 10:05:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27c40b73-4217-5525-8def-8f7189d22661/27c40b73-4217-5525-8def-8f7189d22661_image_8.jpg HTTP/1.1" 201 0
2025-12-04 10:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F344b9b73-5087-49b0-835a-3de2e774a198_9.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/344b9b73-5087-49b0-835a-3de2e774a198_9.jpg saved to cache
2025-12-04 10:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 27c40b73-4217-5525-8def-8f7189d22661
2025-12-04 10:05:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cceba650>
2025-12-04 10:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07a43b40-c094-5b22-b61d-8f11e55e71c0/07a43b40-c094-5b22-b61d-8f11e55e71c0_image_4.jpg HTTP/1.1" 201 0
2025-12-04 10:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdbdb3c14-3fe2-450a-98a7-33597d0542ed_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dbdb3c14-3fe2-450a-98a7-33597d0542ed_5.jpg saved to cache
2025-12-04 10:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 07a43b40-c094-5b22-b61d-8f11e55e71c0
2025-12-04 10:05:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5c0250>
2025-12-04 10:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27c40b73-4217-5525-8def-8f7189d22661/27c40b73-4217-5525-8def-8f7189d22661_image_7.jpg HTTP/1.1" 201 0
2025-12-04 10:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F344b9b73-5087-49b0-835a-3de2e774a198_10.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/344b9b73-5087-49b0-835a-3de2e774a198_10.jpg saved to cache
2025-12-04 10:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 27c40b73-4217-5525-8def-8f7189d22661
2025-12-04 10:05:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccdf5390>
2025-12-04 10:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07a43b40-c094-5b22-b61d-8f11e55e71c0/07a43b40-c094-5b22-b61d-8f11e55e71c0_image_6.jpg HTTP/1.1" 201 0
2025-12-04 10:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdbdb3c14-3fe2-450a-98a7-33597d0542ed_11.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dbdb3c14-3fe2-450a-98a7-33597d0542ed_11.jpg saved to cache
2025-12-04 10:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 07a43b40-c094-5b22-b61d-8f11e55e71c0
2025-12-04 10:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3740756-3983360-43.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3740756-3983360-43.jpg not downloaded yet
2025-12-04 10:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737655-3988786-6.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737655-3988786-6.jpg not downloaded yet
2025-12-04 10:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3740756-3983360-44.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3740756-3983360-44.jpg not downloaded yet
2025-12-04 10:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737655-3988786-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737655-3988786-13.jpg not downloaded yet
2025-12-04 10:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/AUDI/A1?id=3737427&returnUrl=%2Fsearch%3FPage%3D4%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233737427&indx=358> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 10:05:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34cde10d-e88c-5c3a-806a-92b38a5272d1 with identifier: 3737981
2025-12-04 10:05:11 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 34cde10d-e88c-5c3a-806a-92b38a5272d1
2025-12-04 10:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/344b9b73-5087-49b0-835a-3de2e774a198_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003740756-01978016-001.pdf)
2025-12-04 10:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/344b9b73-5087-49b0-835a-3de2e774a198_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003740756-01978016-001.pdf)
2025-12-04 10:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/344b9b73-5087-49b0-835a-3de2e774a198_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003740756-01978016-001.pdf)
2025-12-04 10:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737655-3988786-8.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737655-3988786-8.jpg not downloaded yet
2025-12-04 10:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3740756-3983360-15.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003740756-01978016-001.pdf)
2025-12-04 10:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/344b9b73-5087-49b0-835a-3de2e774a198_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003740756-01978016-001.pdf)
2025-12-04 10:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3737655-3988786-2.jpg> (referer: None)
2025-12-04 10:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3740756-4002138-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003740756-01978016-001.pdf)
2025-12-04 10:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737655-3988786-15.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737655-3988786-15.jpg not downloaded yet
2025-12-04 10:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737655-3988786-16.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737655-3988786-16.jpg not downloaded yet
2025-12-04 10:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3737655-3988786-1.jpg> (referer: None)
2025-12-04 10:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737655-3988786-28.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737655-3988786-28.jpg not downloaded yet
2025-12-04 10:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003737837-01987105-002.pdf> (referer: None)
2025-12-04 10:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737655-3988786-39.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737655-3988786-39.jpg not downloaded yet
2025-12-04 10:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737655-3988786-42.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737655-3988786-42.jpg not downloaded yet
2025-12-04 10:05:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07143d03-abd8-5a9e-91eb-582acdbfe50b with identifier: 3737427
2025-12-04 10:05:11 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 07143d03-abd8-5a9e-91eb-582acdbfe50b
2025-12-04 10:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737655-3988786-43.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737655-3988786-43.jpg not downloaded yet
2025-12-04 10:05:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6f2d50>
2025-12-04 10:05:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27c40b73-4217-5525-8def-8f7189d22661/27c40b73-4217-5525-8def-8f7189d22661_image_12.jpg HTTP/1.1" 201 0
2025-12-04 10:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F344b9b73-5087-49b0-835a-3de2e774a198_ext_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/344b9b73-5087-49b0-835a-3de2e774a198_ext_4.jpg saved to cache
2025-12-04 10:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 27c40b73-4217-5525-8def-8f7189d22661
2025-12-04 10:05:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5ab210>
2025-12-04 10:05:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27c40b73-4217-5525-8def-8f7189d22661/27c40b73-4217-5525-8def-8f7189d22661_image_9.jpg HTTP/1.1" 201 0
2025-12-04 10:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F344b9b73-5087-49b0-835a-3de2e774a198_ext_2.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/344b9b73-5087-49b0-835a-3de2e774a198_ext_2.jpg saved to cache
2025-12-04 10:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 27c40b73-4217-5525-8def-8f7189d22661
2025-12-04 10:05:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cccdbfd0>
2025-12-04 10:05:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27c40b73-4217-5525-8def-8f7189d22661/27c40b73-4217-5525-8def-8f7189d22661_image_11.jpg HTTP/1.1" 201 0
2025-12-04 10:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F344b9b73-5087-49b0-835a-3de2e774a198_ext_3.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/344b9b73-5087-49b0-835a-3de2e774a198_ext_3.jpg saved to cache
2025-12-04 10:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 27c40b73-4217-5525-8def-8f7189d22661
2025-12-04 10:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737655-3988786-44.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737655-3988786-44.jpg not downloaded yet
2025-12-04 10:05:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf5b2d0>
2025-12-04 10:05:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27c40b73-4217-5525-8def-8f7189d22661/27c40b73-4217-5525-8def-8f7189d22661_image_14.jpg HTTP/1.1" 201 0
2025-12-04 10:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3740756-3983360-15.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3740756-3983360-15.jpg saved to cache
2025-12-04 10:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 27c40b73-4217-5525-8def-8f7189d22661
2025-12-04 10:05:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd0a3b50>
2025-12-04 10:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 10:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27c40b73-4217-5525-8def-8f7189d22661/27c40b73-4217-5525-8def-8f7189d22661_image_10.jpg HTTP/1.1" 201 0
2025-12-04 10:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F344b9b73-5087-49b0-835a-3de2e774a198_ext_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/344b9b73-5087-49b0-835a-3de2e774a198_ext_5.jpg saved to cache
2025-12-04 10:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 27c40b73-4217-5525-8def-8f7189d22661
2025-12-04 10:05:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd0a1a10>
2025-12-04 10:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_823fa041-4c2f-5fa5-b851-cbe9c59b2804/823fa041-4c2f-5fa5-b851-cbe9c59b2804_image_1.jpg HTTP/1.1" 201 0
2025-12-04 10:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737655-3988786-2.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737655-3988786-2.jpg saved to cache
2025-12-04 10:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 823fa041-4c2f-5fa5-b851-cbe9c59b2804
2025-12-04 10:05:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccc5dd10>
2025-12-04 10:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27c40b73-4217-5525-8def-8f7189d22661/27c40b73-4217-5525-8def-8f7189d22661_image_13.jpg HTTP/1.1" 201 0
2025-12-04 10:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3740756-4002138-13.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3740756-4002138-13.jpg saved to cache
2025-12-04 10:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 27c40b73-4217-5525-8def-8f7189d22661
2025-12-04 10:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737655-3988786-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737655-3988786-1000.jpg not downloaded yet
2025-12-04 10:05:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3740756-3983360-44.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003740756-01978016-001.pdf)
2025-12-04 10:05:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3740756-3983360-43.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003740756-01978016-001.pdf)
2025-12-04 10:05:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3737655-3988786-16.jpg> (referer: None)
2025-12-04 10:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737655-3988786-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737655-3988786-1001.jpg not downloaded yet
2025-12-04 10:05:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6e0450>
2025-12-04 10:05:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_823fa041-4c2f-5fa5-b851-cbe9c59b2804/823fa041-4c2f-5fa5-b851-cbe9c59b2804_image_0.jpg HTTP/1.1" 201 0
2025-12-04 10:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737655-3988786-1.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737655-3988786-1.jpg saved to cache
2025-12-04 10:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 823fa041-4c2f-5fa5-b851-cbe9c59b2804
2025-12-04 10:05:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc545550>
2025-12-04 10:05:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbf6a261-72e5-58f4-adf3-e63bfe23c322/cbf6a261-72e5-58f4-adf3-e63bfe23c322_expert_report_file_53191d07-fce4-4504-a5bb-7fbdbe2649bd.pdf HTTP/1.1" 201 0
2025-12-04 10:05:14 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item cbf6a261-72e5-58f4-adf3-e63bfe23c322
2025-12-04 10:05:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cbf6a261-72e5-58f4-adf3-e63bfe23c322, skipping ID generation
2025-12-04 10:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item cbf6a261-72e5-58f4-adf3-e63bfe23c322
2025-12-04 10:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7787796d-09e9-45c7-9633-610d7ed6024b_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7787796d-09e9-45c7-9633-610d7ed6024b_ext_7.jpg not downloaded yet
2025-12-04 10:05:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3737655-3988786-13.jpg> (referer: None)
2025-12-04 10:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737655-3988786-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737655-3988786-1002.jpg not downloaded yet
2025-12-04 10:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7787796d-09e9-45c7-9633-610d7ed6024b_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7787796d-09e9-45c7-9633-610d7ed6024b_ext_7.jpg not downloaded yet
2025-12-04 10:05:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3737655-3988786-6.jpg> (referer: None)
2025-12-04 10:05:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3740756-3983360-39.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003740756-01978016-001.pdf)
2025-12-04 10:05:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3737655-3988786-8.jpg> (referer: None)
2025-12-04 10:05:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003737761-01967847-003.pdf> (referer: None)
2025-12-04 10:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737655-3988786-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737655-3988786-1003.jpg not downloaded yet
2025-12-04 10:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7787796d-09e9-45c7-9633-610d7ed6024b_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7787796d-09e9-45c7-9633-610d7ed6024b_ext_6.jpg not downloaded yet
2025-12-04 10:05:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3737655-3988786-4.jpg> (referer: None)
2025-12-04 10:05:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccea8f90>
2025-12-04 10:05:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 10:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27c40b73-4217-5525-8def-8f7189d22661/27c40b73-4217-5525-8def-8f7189d22661_image_19.jpg HTTP/1.1" 201 0
2025-12-04 10:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3740756-3983360-44.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3740756-3983360-44.jpg saved to cache
2025-12-04 10:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 27c40b73-4217-5525-8def-8f7189d22661
2025-12-04 10:05:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6faa90>
2025-12-04 10:05:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27c40b73-4217-5525-8def-8f7189d22661/27c40b73-4217-5525-8def-8f7189d22661_image_18.jpg HTTP/1.1" 201 0
2025-12-04 10:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3740756-3983360-43.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3740756-3983360-43.jpg saved to cache
2025-12-04 10:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 27c40b73-4217-5525-8def-8f7189d22661
2025-12-04 10:05:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce2ce50>
2025-12-04 10:05:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_823fa041-4c2f-5fa5-b851-cbe9c59b2804/823fa041-4c2f-5fa5-b851-cbe9c59b2804_image_8.jpg HTTP/1.1" 201 0
2025-12-04 10:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737655-3988786-16.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737655-3988786-16.jpg saved to cache
2025-12-04 10:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 823fa041-4c2f-5fa5-b851-cbe9c59b2804
2025-12-04 10:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737655-3988786-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737655-3988786-1004.jpg not downloaded yet
2025-12-04 10:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7787796d-09e9-45c7-9633-610d7ed6024b_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7787796d-09e9-45c7-9633-610d7ed6024b_ext_1.jpg not downloaded yet
2025-12-04 10:05:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/AUDI/A3?id=3739898&returnUrl=%2Fsearch%3FPage%3D4%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233739898&indx=364> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 10:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737655-3988786-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737655-3988786-1005.jpg not downloaded yet
2025-12-04 10:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7787796d-09e9-45c7-9633-610d7ed6024b_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7787796d-09e9-45c7-9633-610d7ed6024b_5.jpg not downloaded yet
2025-12-04 10:05:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7787796d-09e9-45c7-9633-610d7ed6024b_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737837-01987105-002.pdf)
2025-12-04 10:05:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3737655-3988786-44.jpg> (referer: None)
2025-12-04 10:05:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3737655-3988786-43.jpg> (referer: None)
2025-12-04 10:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7787796d-09e9-45c7-9633-610d7ed6024b_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7787796d-09e9-45c7-9633-610d7ed6024b_4.jpg not downloaded yet
2025-12-04 10:05:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd2fc90>
2025-12-04 10:05:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_823fa041-4c2f-5fa5-b851-cbe9c59b2804/823fa041-4c2f-5fa5-b851-cbe9c59b2804_image_5.jpg HTTP/1.1" 201 0
2025-12-04 10:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737655-3988786-13.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737655-3988786-13.jpg saved to cache
2025-12-04 10:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 823fa041-4c2f-5fa5-b851-cbe9c59b2804
2025-12-04 10:05:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf74850>
2025-12-04 10:05:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_823fa041-4c2f-5fa5-b851-cbe9c59b2804/823fa041-4c2f-5fa5-b851-cbe9c59b2804_image_4.jpg HTTP/1.1" 201 0
2025-12-04 10:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737655-3988786-6.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737655-3988786-6.jpg saved to cache
2025-12-04 10:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 823fa041-4c2f-5fa5-b851-cbe9c59b2804
2025-12-04 10:05:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccefd650>
2025-12-04 10:05:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 10:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27c40b73-4217-5525-8def-8f7189d22661/27c40b73-4217-5525-8def-8f7189d22661_image_17.jpg HTTP/1.1" 201 0
2025-12-04 10:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3740756-3983360-39.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3740756-3983360-39.jpg saved to cache
2025-12-04 10:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 27c40b73-4217-5525-8def-8f7189d22661
2025-12-04 10:05:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd11c610>
2025-12-04 10:05:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_823fa041-4c2f-5fa5-b851-cbe9c59b2804/823fa041-4c2f-5fa5-b851-cbe9c59b2804_image_6.jpg HTTP/1.1" 201 0
2025-12-04 10:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737655-3988786-8.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737655-3988786-8.jpg saved to cache
2025-12-04 10:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 823fa041-4c2f-5fa5-b851-cbe9c59b2804
2025-12-04 10:05:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc619390>
2025-12-04 10:05:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_417a6ff8-aba3-55b0-b54f-462a6dc74cf6/417a6ff8-aba3-55b0-b54f-462a6dc74cf6_expert_report_file_b32ffafd-2c14-4bbe-8d80-3e284ea9bee5.pdf HTTP/1.1" 201 0
2025-12-04 10:05:17 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 417a6ff8-aba3-55b0-b54f-462a6dc74cf6
2025-12-04 10:05:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 417a6ff8-aba3-55b0-b54f-462a6dc74cf6, skipping ID generation
2025-12-04 10:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 417a6ff8-aba3-55b0-b54f-462a6dc74cf6
2025-12-04 10:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5d248c1a-99e8-479d-9907-c883d119f466_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5d248c1a-99e8-479d-9907-c883d119f466_ext_7.jpg not downloaded yet
2025-12-04 10:05:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc7f6d50>
2025-12-04 10:05:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_823fa041-4c2f-5fa5-b851-cbe9c59b2804/823fa041-4c2f-5fa5-b851-cbe9c59b2804_image_3.jpg HTTP/1.1" 201 0
2025-12-04 10:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737655-3988786-4.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737655-3988786-4.jpg saved to cache
2025-12-04 10:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 823fa041-4c2f-5fa5-b851-cbe9c59b2804
2025-12-04 10:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003737827-01964216-002.pdf> (referer: None)
2025-12-04 10:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3737655-3988786-28.jpg> (referer: None)
2025-12-04 10:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3737655-3988786-1000.jpg> (referer: None)
2025-12-04 10:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3737655-3988786-42.jpg> (referer: None)
2025-12-04 10:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3737655-3988786-1001.jpg> (referer: None)
2025-12-04 10:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7787796d-09e9-45c7-9633-610d7ed6024b_11.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7787796d-09e9-45c7-9633-610d7ed6024b_11.jpg not downloaded yet
2025-12-04 10:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5d248c1a-99e8-479d-9907-c883d119f466_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5d248c1a-99e8-479d-9907-c883d119f466_ext_7.jpg not downloaded yet
2025-12-04 10:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7787796d-09e9-45c7-9633-610d7ed6024b_10.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7787796d-09e9-45c7-9633-610d7ed6024b_10.jpg not downloaded yet
2025-12-04 10:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5d248c1a-99e8-479d-9907-c883d119f466_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5d248c1a-99e8-479d-9907-c883d119f466_ext_6.jpg not downloaded yet
2025-12-04 10:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7787796d-09e9-45c7-9633-610d7ed6024b_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737837-01987105-002.pdf)
2025-12-04 10:05:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a78d527e-dc6e-518f-ad6e-20beb5b60643 with identifier: 3739898
2025-12-04 10:05:18 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item a78d527e-dc6e-518f-ad6e-20beb5b60643
2025-12-04 10:05:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf80350>
2025-12-04 10:05:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbf6a261-72e5-58f4-adf3-e63bfe23c322/cbf6a261-72e5-58f4-adf3-e63bfe23c322_image_0.jpg HTTP/1.1" 201 0
2025-12-04 10:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7787796d-09e9-45c7-9633-610d7ed6024b_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7787796d-09e9-45c7-9633-610d7ed6024b_ext_7.jpg saved to cache
2025-12-04 10:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cbf6a261-72e5-58f4-adf3-e63bfe23c322
2025-12-04 10:05:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce2d6d0>
2025-12-04 10:05:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_823fa041-4c2f-5fa5-b851-cbe9c59b2804/823fa041-4c2f-5fa5-b851-cbe9c59b2804_image_13.jpg HTTP/1.1" 201 0
2025-12-04 10:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737655-3988786-44.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737655-3988786-44.jpg saved to cache
2025-12-04 10:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 823fa041-4c2f-5fa5-b851-cbe9c59b2804
2025-12-04 10:05:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd0c3a50>
2025-12-04 10:05:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 10:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_823fa041-4c2f-5fa5-b851-cbe9c59b2804/823fa041-4c2f-5fa5-b851-cbe9c59b2804_image_12.jpg HTTP/1.1" 201 0
2025-12-04 10:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737655-3988786-43.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737655-3988786-43.jpg saved to cache
2025-12-04 10:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 823fa041-4c2f-5fa5-b851-cbe9c59b2804
2025-12-04 10:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3737655-3988786-1004.jpg> (referer: None)
2025-12-04 10:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7787796d-09e9-45c7-9633-610d7ed6024b_9.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7787796d-09e9-45c7-9633-610d7ed6024b_9.jpg not downloaded yet
2025-12-04 10:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5d248c1a-99e8-479d-9907-c883d119f466_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5d248c1a-99e8-479d-9907-c883d119f466_ext_1.jpg not downloaded yet
2025-12-04 10:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7787796d-09e9-45c7-9633-610d7ed6024b_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7787796d-09e9-45c7-9633-610d7ed6024b_ext_2.jpg not downloaded yet
2025-12-04 10:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5d248c1a-99e8-479d-9907-c883d119f466_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5d248c1a-99e8-479d-9907-c883d119f466_5.jpg not downloaded yet
2025-12-04 10:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7787796d-09e9-45c7-9633-610d7ed6024b_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737837-01987105-002.pdf)
2025-12-04 10:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7787796d-09e9-45c7-9633-610d7ed6024b_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7787796d-09e9-45c7-9633-610d7ed6024b_ext_5.jpg not downloaded yet
2025-12-04 10:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5d248c1a-99e8-479d-9907-c883d119f466_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5d248c1a-99e8-479d-9907-c883d119f466_4.jpg not downloaded yet
2025-12-04 10:05:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc69fc50>
2025-12-04 10:05:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dbba9f9-5f80-5b85-b53c-7bfc7d08b658/0dbba9f9-5f80-5b85-b53c-7bfc7d08b658_expert_report_file_43da647c-d37a-49e5-b109-70de6bbe594a.pdf HTTP/1.1" 201 0
2025-12-04 10:05:19 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 0dbba9f9-5f80-5b85-b53c-7bfc7d08b658
2025-12-04 10:05:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0dbba9f9-5f80-5b85-b53c-7bfc7d08b658, skipping ID generation
2025-12-04 10:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 0dbba9f9-5f80-5b85-b53c-7bfc7d08b658
2025-12-04 10:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5f19311e-963e-4d0f-ba66-5d0b7d6a764a_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5f19311e-963e-4d0f-ba66-5d0b7d6a764a_ext_7.jpg not downloaded yet
2025-12-04 10:05:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6e5810>
2025-12-04 10:05:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_823fa041-4c2f-5fa5-b851-cbe9c59b2804/823fa041-4c2f-5fa5-b851-cbe9c59b2804_image_9.jpg HTTP/1.1" 201 0
2025-12-04 10:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737655-3988786-28.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737655-3988786-28.jpg saved to cache
2025-12-04 10:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 823fa041-4c2f-5fa5-b851-cbe9c59b2804
2025-12-04 10:05:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6cf8d0>
2025-12-04 10:05:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_823fa041-4c2f-5fa5-b851-cbe9c59b2804/823fa041-4c2f-5fa5-b851-cbe9c59b2804_image_14.jpg HTTP/1.1" 201 0
2025-12-04 10:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737655-3988786-1000.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737655-3988786-1000.jpg saved to cache
2025-12-04 10:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 823fa041-4c2f-5fa5-b851-cbe9c59b2804
2025-12-04 10:05:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccfc2c90>
2025-12-04 10:05:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_823fa041-4c2f-5fa5-b851-cbe9c59b2804/823fa041-4c2f-5fa5-b851-cbe9c59b2804_image_11.jpg HTTP/1.1" 201 0
2025-12-04 10:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737655-3988786-42.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737655-3988786-42.jpg saved to cache
2025-12-04 10:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 823fa041-4c2f-5fa5-b851-cbe9c59b2804
2025-12-04 10:05:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccef28d0>
2025-12-04 10:05:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_823fa041-4c2f-5fa5-b851-cbe9c59b2804/823fa041-4c2f-5fa5-b851-cbe9c59b2804_image_15.jpg HTTP/1.1" 201 0
2025-12-04 10:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737655-3988786-1001.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737655-3988786-1001.jpg saved to cache
2025-12-04 10:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 823fa041-4c2f-5fa5-b851-cbe9c59b2804
2025-12-04 10:05:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf84690>
2025-12-04 10:05:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbf6a261-72e5-58f4-adf3-e63bfe23c322/cbf6a261-72e5-58f4-adf3-e63bfe23c322_image_3.jpg HTTP/1.1" 201 0
2025-12-04 10:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7787796d-09e9-45c7-9633-610d7ed6024b_ext_1.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7787796d-09e9-45c7-9633-610d7ed6024b_ext_1.jpg saved to cache
2025-12-04 10:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cbf6a261-72e5-58f4-adf3-e63bfe23c322
2025-12-04 10:05:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003737427-01985255-002.pdf> (referer: None)
2025-12-04 10:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7787796d-09e9-45c7-9633-610d7ed6024b_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7787796d-09e9-45c7-9633-610d7ed6024b_ext_3.jpg not downloaded yet
2025-12-04 10:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5d248c1a-99e8-479d-9907-c883d119f466_11.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5d248c1a-99e8-479d-9907-c883d119f466_11.jpg not downloaded yet
2025-12-04 10:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5f19311e-963e-4d0f-ba66-5d0b7d6a764a_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5f19311e-963e-4d0f-ba66-5d0b7d6a764a_ext_7.jpg not downloaded yet
2025-12-04 10:05:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd0d9450>
2025-12-04 10:05:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_823fa041-4c2f-5fa5-b851-cbe9c59b2804/823fa041-4c2f-5fa5-b851-cbe9c59b2804_image_18.jpg HTTP/1.1" 201 0
2025-12-04 10:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737655-3988786-1004.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737655-3988786-1004.jpg saved to cache
2025-12-04 10:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 823fa041-4c2f-5fa5-b851-cbe9c59b2804
2025-12-04 10:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7787796d-09e9-45c7-9633-610d7ed6024b_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7787796d-09e9-45c7-9633-610d7ed6024b_ext_4.jpg not downloaded yet
2025-12-04 10:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5d248c1a-99e8-479d-9907-c883d119f466_10.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5d248c1a-99e8-479d-9907-c883d119f466_10.jpg not downloaded yet
2025-12-04 10:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5f19311e-963e-4d0f-ba66-5d0b7d6a764a_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5f19311e-963e-4d0f-ba66-5d0b7d6a764a_ext_6.jpg not downloaded yet
2025-12-04 10:05:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf0ae10>
2025-12-04 10:05:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbf6a261-72e5-58f4-adf3-e63bfe23c322/cbf6a261-72e5-58f4-adf3-e63bfe23c322_image_2.jpg HTTP/1.1" 201 0
2025-12-04 10:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7787796d-09e9-45c7-9633-610d7ed6024b_ext_6.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7787796d-09e9-45c7-9633-610d7ed6024b_ext_6.jpg saved to cache
2025-12-04 10:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cbf6a261-72e5-58f4-adf3-e63bfe23c322
2025-12-04 10:05:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd65c10>
2025-12-04 10:05:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07143d03-abd8-5a9e-91eb-582acdbfe50b/07143d03-abd8-5a9e-91eb-582acdbfe50b_expert_report_file_e5c59b2c-406c-4ef8-858e-b1af72f1cb37.pdf HTTP/1.1" 201 0
2025-12-04 10:05:22 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 07143d03-abd8-5a9e-91eb-582acdbfe50b
2025-12-04 10:05:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 07143d03-abd8-5a9e-91eb-582acdbfe50b, skipping ID generation
2025-12-04 10:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 07143d03-abd8-5a9e-91eb-582acdbfe50b
2025-12-04 10:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4eb6f4e5-e171-43fa-9c5a-6dca1f62c1d6_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4eb6f4e5-e171-43fa-9c5a-6dca1f62c1d6_ext_7.jpg not downloaded yet
2025-12-04 10:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737837-4005180-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737837-4005180-13.jpg not downloaded yet
2025-12-04 10:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5d248c1a-99e8-479d-9907-c883d119f466_9.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5d248c1a-99e8-479d-9907-c883d119f466_9.jpg not downloaded yet
2025-12-04 10:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5f19311e-963e-4d0f-ba66-5d0b7d6a764a_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5f19311e-963e-4d0f-ba66-5d0b7d6a764a_ext_1.jpg not downloaded yet
2025-12-04 10:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4eb6f4e5-e171-43fa-9c5a-6dca1f62c1d6_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4eb6f4e5-e171-43fa-9c5a-6dca1f62c1d6_ext_7.jpg not downloaded yet
2025-12-04 10:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737837-4005180-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737837-4005180-1000.jpg not downloaded yet
2025-12-04 10:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5d248c1a-99e8-479d-9907-c883d119f466_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5d248c1a-99e8-479d-9907-c883d119f466_ext_2.jpg not downloaded yet
2025-12-04 10:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5f19311e-963e-4d0f-ba66-5d0b7d6a764a_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5f19311e-963e-4d0f-ba66-5d0b7d6a764a_5.jpg not downloaded yet
2025-12-04 10:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4eb6f4e5-e171-43fa-9c5a-6dca1f62c1d6_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4eb6f4e5-e171-43fa-9c5a-6dca1f62c1d6_ext_6.jpg not downloaded yet
2025-12-04 10:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737837-4005180-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737837-4005180-1001.jpg not downloaded yet
2025-12-04 10:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5d248c1a-99e8-479d-9907-c883d119f466_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5d248c1a-99e8-479d-9907-c883d119f466_ext_5.jpg not downloaded yet
2025-12-04 10:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5f19311e-963e-4d0f-ba66-5d0b7d6a764a_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5f19311e-963e-4d0f-ba66-5d0b7d6a764a_4.jpg not downloaded yet
2025-12-04 10:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4eb6f4e5-e171-43fa-9c5a-6dca1f62c1d6_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4eb6f4e5-e171-43fa-9c5a-6dca1f62c1d6_ext_1.jpg not downloaded yet
2025-12-04 10:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737837-4005180-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737837-4005180-1002.jpg not downloaded yet
2025-12-04 10:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5d248c1a-99e8-479d-9907-c883d119f466_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5d248c1a-99e8-479d-9907-c883d119f466_ext_3.jpg not downloaded yet
2025-12-04 10:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5f19311e-963e-4d0f-ba66-5d0b7d6a764a_11.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5f19311e-963e-4d0f-ba66-5d0b7d6a764a_11.jpg not downloaded yet
2025-12-04 10:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4eb6f4e5-e171-43fa-9c5a-6dca1f62c1d6_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4eb6f4e5-e171-43fa-9c5a-6dca1f62c1d6_5.jpg not downloaded yet
2025-12-04 10:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737837-4005180-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737837-4005180-1003.jpg not downloaded yet
2025-12-04 10:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5d248c1a-99e8-479d-9907-c883d119f466_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5d248c1a-99e8-479d-9907-c883d119f466_ext_4.jpg not downloaded yet
2025-12-04 10:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5f19311e-963e-4d0f-ba66-5d0b7d6a764a_10.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5f19311e-963e-4d0f-ba66-5d0b7d6a764a_10.jpg not downloaded yet
2025-12-04 10:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4eb6f4e5-e171-43fa-9c5a-6dca1f62c1d6_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4eb6f4e5-e171-43fa-9c5a-6dca1f62c1d6_4.jpg not downloaded yet
2025-12-04 10:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737837-4005180-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737837-4005180-1004.jpg not downloaded yet
2025-12-04 10:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737761-3983477-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737761-3983477-13.jpg not downloaded yet
2025-12-04 10:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5f19311e-963e-4d0f-ba66-5d0b7d6a764a_9.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5f19311e-963e-4d0f-ba66-5d0b7d6a764a_9.jpg not downloaded yet
2025-12-04 10:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4eb6f4e5-e171-43fa-9c5a-6dca1f62c1d6_11.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4eb6f4e5-e171-43fa-9c5a-6dca1f62c1d6_11.jpg not downloaded yet
2025-12-04 10:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737837-4005180-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737837-4005180-1005.jpg not downloaded yet
2025-12-04 10:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737761-3983477-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737761-3983477-1000.jpg not downloaded yet
2025-12-04 10:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5f19311e-963e-4d0f-ba66-5d0b7d6a764a_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5f19311e-963e-4d0f-ba66-5d0b7d6a764a_ext_2.jpg not downloaded yet
2025-12-04 10:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4eb6f4e5-e171-43fa-9c5a-6dca1f62c1d6_10.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4eb6f4e5-e171-43fa-9c5a-6dca1f62c1d6_10.jpg not downloaded yet
2025-12-04 10:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737761-3983477-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737761-3983477-1001.jpg not downloaded yet
2025-12-04 10:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5f19311e-963e-4d0f-ba66-5d0b7d6a764a_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5f19311e-963e-4d0f-ba66-5d0b7d6a764a_ext_5.jpg not downloaded yet
2025-12-04 10:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4eb6f4e5-e171-43fa-9c5a-6dca1f62c1d6_9.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4eb6f4e5-e171-43fa-9c5a-6dca1f62c1d6_9.jpg not downloaded yet
2025-12-04 10:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737761-3983477-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737761-3983477-1002.jpg not downloaded yet
2025-12-04 10:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5f19311e-963e-4d0f-ba66-5d0b7d6a764a_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5f19311e-963e-4d0f-ba66-5d0b7d6a764a_ext_3.jpg not downloaded yet
2025-12-04 10:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4eb6f4e5-e171-43fa-9c5a-6dca1f62c1d6_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4eb6f4e5-e171-43fa-9c5a-6dca1f62c1d6_ext_2.jpg not downloaded yet
2025-12-04 10:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737761-3983477-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737761-3983477-1003.jpg not downloaded yet
2025-12-04 10:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5f19311e-963e-4d0f-ba66-5d0b7d6a764a_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5f19311e-963e-4d0f-ba66-5d0b7d6a764a_ext_4.jpg not downloaded yet
2025-12-04 10:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4eb6f4e5-e171-43fa-9c5a-6dca1f62c1d6_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4eb6f4e5-e171-43fa-9c5a-6dca1f62c1d6_ext_5.jpg not downloaded yet
2025-12-04 10:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737761-3983477-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737761-3983477-1004.jpg not downloaded yet
2025-12-04 10:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737827-3994076-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737827-3994076-13.jpg not downloaded yet
2025-12-04 10:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4eb6f4e5-e171-43fa-9c5a-6dca1f62c1d6_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4eb6f4e5-e171-43fa-9c5a-6dca1f62c1d6_ext_3.jpg not downloaded yet
2025-12-04 10:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737761-3983477-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737761-3983477-1005.jpg not downloaded yet
2025-12-04 10:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737827-3994076-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737827-3994076-1000.jpg not downloaded yet
2025-12-04 10:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4eb6f4e5-e171-43fa-9c5a-6dca1f62c1d6_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4eb6f4e5-e171-43fa-9c5a-6dca1f62c1d6_ext_4.jpg not downloaded yet
2025-12-04 10:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3737837-4005180-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737837-01987105-002.pdf)
2025-12-04 10:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737827-3994076-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737827-3994076-1001.jpg not downloaded yet
2025-12-04 10:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737427-4004763-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737427-4004763-13.jpg not downloaded yet
2025-12-04 10:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737827-3994076-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737827-3994076-1002.jpg not downloaded yet
2025-12-04 10:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737427-4004763-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737427-4004763-1000.jpg not downloaded yet
2025-12-04 10:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737827-3994076-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737827-3994076-1003.jpg not downloaded yet
2025-12-04 10:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737427-4004763-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737427-4004763-1001.jpg not downloaded yet
2025-12-04 10:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737827-3994076-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737827-3994076-1004.jpg not downloaded yet
2025-12-04 10:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4eb6f4e5-e171-43fa-9c5a-6dca1f62c1d6_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737427-01985255-002.pdf)
2025-12-04 10:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737427-4004763-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737427-4004763-1002.jpg not downloaded yet
2025-12-04 10:05:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cccb0050>
2025-12-04 10:05:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbf6a261-72e5-58f4-adf3-e63bfe23c322/cbf6a261-72e5-58f4-adf3-e63bfe23c322_image_19.jpg HTTP/1.1" 201 0
2025-12-04 10:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737837-4005180-1005.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737837-4005180-1005.jpg saved to cache
2025-12-04 10:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item cbf6a261-72e5-58f4-adf3-e63bfe23c322
2025-12-04 10:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3737761-3983477-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737761-01967847-003.pdf)
2025-12-04 10:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3737761-3983477-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737761-01967847-003.pdf)
2025-12-04 10:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4eb6f4e5-e171-43fa-9c5a-6dca1f62c1d6_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737427-01985255-002.pdf)
2025-12-04 10:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737827-3994076-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737827-3994076-1005.jpg not downloaded yet
2025-12-04 10:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737427-4004763-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737427-4004763-1003.jpg not downloaded yet
2025-12-04 10:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5f19311e-963e-4d0f-ba66-5d0b7d6a764a_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737827-01964216-002.pdf)
2025-12-04 10:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/FORD/FIESTA?id=3733236&returnUrl=%2Fsearch%3FPage%3D4%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233733236&indx=355> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 10:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4eb6f4e5-e171-43fa-9c5a-6dca1f62c1d6_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737427-01985255-002.pdf)
2025-12-04 10:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737427-4004763-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737427-4004763-1004.jpg not downloaded yet
2025-12-04 10:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5f19311e-963e-4d0f-ba66-5d0b7d6a764a_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737827-01964216-002.pdf)
2025-12-04 10:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5f19311e-963e-4d0f-ba66-5d0b7d6a764a_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737827-01964216-002.pdf)
2025-12-04 10:05:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cceaa010>
2025-12-04 10:05:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07143d03-abd8-5a9e-91eb-582acdbfe50b/07143d03-abd8-5a9e-91eb-582acdbfe50b_image_7.jpg HTTP/1.1" 201 0
2025-12-04 10:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4eb6f4e5-e171-43fa-9c5a-6dca1f62c1d6_10.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4eb6f4e5-e171-43fa-9c5a-6dca1f62c1d6_10.jpg saved to cache
2025-12-04 10:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 07143d03-abd8-5a9e-91eb-582acdbfe50b
2025-12-04 10:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737427-4004763-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737427-4004763-1005.jpg not downloaded yet
2025-12-04 10:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3737837-4005180-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737837-01987105-002.pdf)
2025-12-04 10:05:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd01c550>
2025-12-04 10:05:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_417a6ff8-aba3-55b0-b54f-462a6dc74cf6/417a6ff8-aba3-55b0-b54f-462a6dc74cf6_image_14.jpg HTTP/1.1" 201 0
2025-12-04 10:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737761-3983477-1000.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737761-3983477-1000.jpg saved to cache
2025-12-04 10:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 417a6ff8-aba3-55b0-b54f-462a6dc74cf6
2025-12-04 10:05:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc713850>
2025-12-04 10:05:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_417a6ff8-aba3-55b0-b54f-462a6dc74cf6/417a6ff8-aba3-55b0-b54f-462a6dc74cf6_image_15.jpg HTTP/1.1" 201 0
2025-12-04 10:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737761-3983477-1001.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737761-3983477-1001.jpg saved to cache
2025-12-04 10:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 417a6ff8-aba3-55b0-b54f-462a6dc74cf6
2025-12-04 10:05:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ce39afd0>
2025-12-04 10:05:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 10:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07143d03-abd8-5a9e-91eb-582acdbfe50b/07143d03-abd8-5a9e-91eb-582acdbfe50b_image_6.jpg HTTP/1.1" 201 0
2025-12-04 10:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4eb6f4e5-e171-43fa-9c5a-6dca1f62c1d6_11.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4eb6f4e5-e171-43fa-9c5a-6dca1f62c1d6_11.jpg saved to cache
2025-12-04 10:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 07143d03-abd8-5a9e-91eb-582acdbfe50b
2025-12-04 10:05:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc54f710>
2025-12-04 10:05:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dbba9f9-5f80-5b85-b53c-7bfc7d08b658/0dbba9f9-5f80-5b85-b53c-7bfc7d08b658_image_8.jpg HTTP/1.1" 201 0
2025-12-04 10:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5f19311e-963e-4d0f-ba66-5d0b7d6a764a_9.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5f19311e-963e-4d0f-ba66-5d0b7d6a764a_9.jpg saved to cache
2025-12-04 10:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0dbba9f9-5f80-5b85-b53c-7bfc7d08b658
2025-12-04 10:05:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd47cf9a-b495-54ed-94b9-5ff59695697b with identifier: 3733236
2025-12-04 10:05:26 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item cd47cf9a-b495-54ed-94b9-5ff59695697b
2025-12-04 10:05:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5f5dd0>
2025-12-04 10:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07143d03-abd8-5a9e-91eb-582acdbfe50b/07143d03-abd8-5a9e-91eb-582acdbfe50b_image_8.jpg HTTP/1.1" 201 0
2025-12-04 10:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4eb6f4e5-e171-43fa-9c5a-6dca1f62c1d6_9.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4eb6f4e5-e171-43fa-9c5a-6dca1f62c1d6_9.jpg saved to cache
2025-12-04 10:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 07143d03-abd8-5a9e-91eb-582acdbfe50b
2025-12-04 10:05:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6d0810>
2025-12-04 10:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dbba9f9-5f80-5b85-b53c-7bfc7d08b658/0dbba9f9-5f80-5b85-b53c-7bfc7d08b658_image_9.jpg HTTP/1.1" 201 0
2025-12-04 10:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5f19311e-963e-4d0f-ba66-5d0b7d6a764a_ext_2.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5f19311e-963e-4d0f-ba66-5d0b7d6a764a_ext_2.jpg saved to cache
2025-12-04 10:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0dbba9f9-5f80-5b85-b53c-7bfc7d08b658
2025-12-04 10:05:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6d2790>
2025-12-04 10:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dbba9f9-5f80-5b85-b53c-7bfc7d08b658/0dbba9f9-5f80-5b85-b53c-7bfc7d08b658_image_10.jpg HTTP/1.1" 201 0
2025-12-04 10:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5f19311e-963e-4d0f-ba66-5d0b7d6a764a_ext_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5f19311e-963e-4d0f-ba66-5d0b7d6a764a_ext_5.jpg saved to cache
2025-12-04 10:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 0dbba9f9-5f80-5b85-b53c-7bfc7d08b658
2025-12-04 10:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4eb6f4e5-e171-43fa-9c5a-6dca1f62c1d6_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737427-01985255-002.pdf)
2025-12-04 10:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4eb6f4e5-e171-43fa-9c5a-6dca1f62c1d6_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737427-01985255-002.pdf)
2025-12-04 10:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3737427-4004763-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737427-01985255-002.pdf)
2025-12-04 10:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3737427-4004763-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737427-01985255-002.pdf)
2025-12-04 10:05:27 [scrapy.extensions.logstats] INFO: Crawled 95 pages (at 33 pages/min), scraped 15 items (at 5 items/min)
2025-12-04 10:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3737761-3983477-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737761-01967847-003.pdf)
2025-12-04 10:05:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce6b850>
2025-12-04 10:05:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbf6a261-72e5-58f4-adf3-e63bfe23c322/cbf6a261-72e5-58f4-adf3-e63bfe23c322_image_18.jpg HTTP/1.1" 201 0
2025-12-04 10:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737837-4005180-1004.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737837-4005180-1004.jpg saved to cache
2025-12-04 10:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item cbf6a261-72e5-58f4-adf3-e63bfe23c322
2025-12-04 10:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3737827-3994076-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737827-01964216-002.pdf)
2025-12-04 10:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3737827-3994076-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737827-01964216-002.pdf)
2025-12-04 10:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3737427-4004763-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737427-01985255-002.pdf)
2025-12-04 10:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3737827-3994076-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737827-01964216-002.pdf)
2025-12-04 10:05:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc69a350>
2025-12-04 10:05:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07143d03-abd8-5a9e-91eb-582acdbfe50b/07143d03-abd8-5a9e-91eb-582acdbfe50b_image_5.jpg HTTP/1.1" 201 0
2025-12-04 10:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4eb6f4e5-e171-43fa-9c5a-6dca1f62c1d6_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4eb6f4e5-e171-43fa-9c5a-6dca1f62c1d6_4.jpg saved to cache
2025-12-04 10:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 07143d03-abd8-5a9e-91eb-582acdbfe50b
2025-12-04 10:05:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd02b110>
2025-12-04 10:05:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07143d03-abd8-5a9e-91eb-582acdbfe50b/07143d03-abd8-5a9e-91eb-582acdbfe50b_image_12.jpg HTTP/1.1" 201 0
2025-12-04 10:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4eb6f4e5-e171-43fa-9c5a-6dca1f62c1d6_ext_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4eb6f4e5-e171-43fa-9c5a-6dca1f62c1d6_ext_4.jpg saved to cache
2025-12-04 10:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 07143d03-abd8-5a9e-91eb-582acdbfe50b
2025-12-04 10:05:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf842d0>
2025-12-04 10:05:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07143d03-abd8-5a9e-91eb-582acdbfe50b/07143d03-abd8-5a9e-91eb-582acdbfe50b_image_16.jpg HTTP/1.1" 201 0
2025-12-04 10:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737427-4004763-1002.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737427-4004763-1002.jpg saved to cache
2025-12-04 10:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 07143d03-abd8-5a9e-91eb-582acdbfe50b
2025-12-04 10:05:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd81210>
2025-12-04 10:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07143d03-abd8-5a9e-91eb-582acdbfe50b/07143d03-abd8-5a9e-91eb-582acdbfe50b_image_15.jpg HTTP/1.1" 201 0
2025-12-04 10:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737427-4004763-1001.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737427-4004763-1001.jpg saved to cache
2025-12-04 10:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 07143d03-abd8-5a9e-91eb-582acdbfe50b
2025-12-04 10:05:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd0d9810>
2025-12-04 10:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_417a6ff8-aba3-55b0-b54f-462a6dc74cf6/417a6ff8-aba3-55b0-b54f-462a6dc74cf6_image_13.jpg HTTP/1.1" 201 0
2025-12-04 10:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737761-3983477-13.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737761-3983477-13.jpg saved to cache
2025-12-04 10:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 417a6ff8-aba3-55b0-b54f-462a6dc74cf6
2025-12-04 10:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3737827-3994076-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737827-01964216-002.pdf)
2025-12-04 10:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3737427-4004763-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737427-01985255-002.pdf)
2025-12-04 10:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3737427-4004763-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737427-01985255-002.pdf)
2025-12-04 10:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3737427-4004763-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737427-01985255-002.pdf)
2025-12-04 10:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3737427-4004763-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737427-01985255-002.pdf)
2025-12-04 10:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3737827-3994076-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737827-01964216-002.pdf)
2025-12-04 10:05:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccfa8d10>
2025-12-04 10:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dbba9f9-5f80-5b85-b53c-7bfc7d08b658/0dbba9f9-5f80-5b85-b53c-7bfc7d08b658_image_18.jpg HTTP/1.1" 201 0
2025-12-04 10:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737827-3994076-1004.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737827-3994076-1004.jpg saved to cache
2025-12-04 10:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 0dbba9f9-5f80-5b85-b53c-7bfc7d08b658
2025-12-04 10:05:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc57b9d0>
2025-12-04 10:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 10:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dbba9f9-5f80-5b85-b53c-7bfc7d08b658/0dbba9f9-5f80-5b85-b53c-7bfc7d08b658_image_17.jpg HTTP/1.1" 201 0
2025-12-04 10:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737827-3994076-1003.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737827-3994076-1003.jpg saved to cache
2025-12-04 10:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 0dbba9f9-5f80-5b85-b53c-7bfc7d08b658
2025-12-04 10:05:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc7f3fd0>
2025-12-04 10:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07143d03-abd8-5a9e-91eb-582acdbfe50b/07143d03-abd8-5a9e-91eb-582acdbfe50b_image_14.jpg HTTP/1.1" 201 0
2025-12-04 10:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737427-4004763-1000.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737427-4004763-1000.jpg saved to cache
2025-12-04 10:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 07143d03-abd8-5a9e-91eb-582acdbfe50b
2025-12-04 10:05:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6f2a10>
2025-12-04 10:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dbba9f9-5f80-5b85-b53c-7bfc7d08b658/0dbba9f9-5f80-5b85-b53c-7bfc7d08b658_image_19.jpg HTTP/1.1" 201 0
2025-12-04 10:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737827-3994076-1005.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737827-3994076-1005.jpg saved to cache
2025-12-04 10:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 0dbba9f9-5f80-5b85-b53c-7bfc7d08b658
2025-12-04 10:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3737827-3994076-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737827-01964216-002.pdf)
2025-12-04 10:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3737761-3983477-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737761-01967847-003.pdf)
2025-12-04 10:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4eb6f4e5-e171-43fa-9c5a-6dca1f62c1d6_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737427-01985255-002.pdf)
2025-12-04 10:05:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6e3e50>
2025-12-04 10:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dbba9f9-5f80-5b85-b53c-7bfc7d08b658/0dbba9f9-5f80-5b85-b53c-7bfc7d08b658_image_16.jpg HTTP/1.1" 201 0
2025-12-04 10:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737827-3994076-1002.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737827-3994076-1002.jpg saved to cache
2025-12-04 10:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 0dbba9f9-5f80-5b85-b53c-7bfc7d08b658
2025-12-04 10:05:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6d4fd0>
2025-12-04 10:05:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07143d03-abd8-5a9e-91eb-582acdbfe50b/07143d03-abd8-5a9e-91eb-582acdbfe50b_image_17.jpg HTTP/1.1" 201 0
2025-12-04 10:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737427-4004763-1003.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737427-4004763-1003.jpg saved to cache
2025-12-04 10:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 07143d03-abd8-5a9e-91eb-582acdbfe50b
2025-12-04 10:05:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc67dbd0>
2025-12-04 10:05:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07143d03-abd8-5a9e-91eb-582acdbfe50b/07143d03-abd8-5a9e-91eb-582acdbfe50b_image_13.jpg HTTP/1.1" 201 0
2025-12-04 10:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737427-4004763-13.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737427-4004763-13.jpg saved to cache
2025-12-04 10:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 07143d03-abd8-5a9e-91eb-582acdbfe50b
2025-12-04 10:05:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc67d190>
2025-12-04 10:05:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07143d03-abd8-5a9e-91eb-582acdbfe50b/07143d03-abd8-5a9e-91eb-582acdbfe50b_image_19.jpg HTTP/1.1" 201 0
2025-12-04 10:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737427-4004763-1005.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737427-4004763-1005.jpg saved to cache
2025-12-04 10:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 07143d03-abd8-5a9e-91eb-582acdbfe50b
2025-12-04 10:05:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6d5ed0>
2025-12-04 10:05:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07143d03-abd8-5a9e-91eb-582acdbfe50b/07143d03-abd8-5a9e-91eb-582acdbfe50b_image_18.jpg HTTP/1.1" 201 0
2025-12-04 10:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737427-4004763-1004.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737427-4004763-1004.jpg saved to cache
2025-12-04 10:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 07143d03-abd8-5a9e-91eb-582acdbfe50b
2025-12-04 10:05:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc67f550>
2025-12-04 10:05:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dbba9f9-5f80-5b85-b53c-7bfc7d08b658/0dbba9f9-5f80-5b85-b53c-7bfc7d08b658_image_14.jpg HTTP/1.1" 201 0
2025-12-04 10:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737827-3994076-1000.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737827-3994076-1000.jpg saved to cache
2025-12-04 10:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 0dbba9f9-5f80-5b85-b53c-7bfc7d08b658
2025-12-04 10:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3737761-3983477-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737761-01967847-003.pdf)
2025-12-04 10:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3737827-3994076-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737827-01964216-002.pdf)
2025-12-04 10:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4eb6f4e5-e171-43fa-9c5a-6dca1f62c1d6_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737427-01985255-002.pdf)
2025-12-04 10:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4eb6f4e5-e171-43fa-9c5a-6dca1f62c1d6_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737427-01985255-002.pdf)
2025-12-04 10:05:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf77e90>
2025-12-04 10:05:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 10:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dbba9f9-5f80-5b85-b53c-7bfc7d08b658/0dbba9f9-5f80-5b85-b53c-7bfc7d08b658_image_15.jpg HTTP/1.1" 201 0
2025-12-04 10:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737827-3994076-1001.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737827-3994076-1001.jpg saved to cache
2025-12-04 10:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 0dbba9f9-5f80-5b85-b53c-7bfc7d08b658
2025-12-04 10:05:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccef3c10>
2025-12-04 10:05:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_417a6ff8-aba3-55b0-b54f-462a6dc74cf6/417a6ff8-aba3-55b0-b54f-462a6dc74cf6_image_19.jpg HTTP/1.1" 201 0
2025-12-04 10:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737761-3983477-1005.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737761-3983477-1005.jpg saved to cache
2025-12-04 10:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 417a6ff8-aba3-55b0-b54f-462a6dc74cf6
2025-12-04 10:05:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd82850>
2025-12-04 10:05:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07143d03-abd8-5a9e-91eb-582acdbfe50b/07143d03-abd8-5a9e-91eb-582acdbfe50b_image_11.jpg HTTP/1.1" 201 0
2025-12-04 10:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4eb6f4e5-e171-43fa-9c5a-6dca1f62c1d6_ext_3.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4eb6f4e5-e171-43fa-9c5a-6dca1f62c1d6_ext_3.jpg saved to cache
2025-12-04 10:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 07143d03-abd8-5a9e-91eb-582acdbfe50b
2025-12-04 10:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5f19311e-963e-4d0f-ba66-5d0b7d6a764a_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737827-01964216-002.pdf)
2025-12-04 10:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5f19311e-963e-4d0f-ba66-5d0b7d6a764a_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737827-01964216-002.pdf)
2025-12-04 10:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3737761-3983477-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737761-01967847-003.pdf)
2025-12-04 10:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3737761-3983477-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737761-01967847-003.pdf)
2025-12-04 10:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5f19311e-963e-4d0f-ba66-5d0b7d6a764a_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737827-01964216-002.pdf)
2025-12-04 10:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5d248c1a-99e8-479d-9907-c883d119f466_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737761-01967847-003.pdf)
2025-12-04 10:05:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd0f52d0>
2025-12-04 10:05:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_417a6ff8-aba3-55b0-b54f-462a6dc74cf6/417a6ff8-aba3-55b0-b54f-462a6dc74cf6_image_18.jpg HTTP/1.1" 201 0
2025-12-04 10:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737761-3983477-1004.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737761-3983477-1004.jpg saved to cache
2025-12-04 10:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 417a6ff8-aba3-55b0-b54f-462a6dc74cf6
2025-12-04 10:05:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5c1450>
2025-12-04 10:05:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dbba9f9-5f80-5b85-b53c-7bfc7d08b658/0dbba9f9-5f80-5b85-b53c-7bfc7d08b658_image_13.jpg HTTP/1.1" 201 0
2025-12-04 10:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737827-3994076-13.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737827-3994076-13.jpg saved to cache
2025-12-04 10:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 0dbba9f9-5f80-5b85-b53c-7bfc7d08b658
2025-12-04 10:05:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc547d10>
2025-12-04 10:05:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07143d03-abd8-5a9e-91eb-582acdbfe50b/07143d03-abd8-5a9e-91eb-582acdbfe50b_image_9.jpg HTTP/1.1" 201 0
2025-12-04 10:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4eb6f4e5-e171-43fa-9c5a-6dca1f62c1d6_ext_2.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4eb6f4e5-e171-43fa-9c5a-6dca1f62c1d6_ext_2.jpg saved to cache
2025-12-04 10:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 07143d03-abd8-5a9e-91eb-582acdbfe50b
2025-12-04 10:05:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce76750>
2025-12-04 10:05:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07143d03-abd8-5a9e-91eb-582acdbfe50b/07143d03-abd8-5a9e-91eb-582acdbfe50b_image_10.jpg HTTP/1.1" 201 0
2025-12-04 10:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4eb6f4e5-e171-43fa-9c5a-6dca1f62c1d6_ext_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4eb6f4e5-e171-43fa-9c5a-6dca1f62c1d6_ext_5.jpg saved to cache
2025-12-04 10:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 07143d03-abd8-5a9e-91eb-582acdbfe50b
2025-12-04 10:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003737981-01982662-003.pdf> (referer: None)
2025-12-04 10:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3737837-4005180-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737837-01987105-002.pdf)
2025-12-04 10:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3737837-4005180-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737837-01987105-002.pdf)
2025-12-04 10:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5f19311e-963e-4d0f-ba66-5d0b7d6a764a_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737827-01964216-002.pdf)
2025-12-04 10:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5f19311e-963e-4d0f-ba66-5d0b7d6a764a_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737827-01964216-002.pdf)
2025-12-04 10:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4eb6f4e5-e171-43fa-9c5a-6dca1f62c1d6_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737427-01985255-002.pdf)
2025-12-04 10:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4eb6f4e5-e171-43fa-9c5a-6dca1f62c1d6_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737427-01985255-002.pdf)
2025-12-04 10:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5d248c1a-99e8-479d-9907-c883d119f466_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737761-01967847-003.pdf)
2025-12-04 10:05:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccfbb850>
2025-12-04 10:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dbba9f9-5f80-5b85-b53c-7bfc7d08b658/0dbba9f9-5f80-5b85-b53c-7bfc7d08b658_image_11.jpg HTTP/1.1" 201 0
2025-12-04 10:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5f19311e-963e-4d0f-ba66-5d0b7d6a764a_ext_3.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5f19311e-963e-4d0f-ba66-5d0b7d6a764a_ext_3.jpg saved to cache
2025-12-04 10:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 0dbba9f9-5f80-5b85-b53c-7bfc7d08b658
2025-12-04 10:05:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ce7bf8d0>
2025-12-04 10:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dbba9f9-5f80-5b85-b53c-7bfc7d08b658/0dbba9f9-5f80-5b85-b53c-7bfc7d08b658_image_12.jpg HTTP/1.1" 201 0
2025-12-04 10:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5f19311e-963e-4d0f-ba66-5d0b7d6a764a_ext_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5f19311e-963e-4d0f-ba66-5d0b7d6a764a_ext_4.jpg saved to cache
2025-12-04 10:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 0dbba9f9-5f80-5b85-b53c-7bfc7d08b658
2025-12-04 10:05:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6d1d90>
2025-12-04 10:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_417a6ff8-aba3-55b0-b54f-462a6dc74cf6/417a6ff8-aba3-55b0-b54f-462a6dc74cf6_image_16.jpg HTTP/1.1" 201 0
2025-12-04 10:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737761-3983477-1002.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737761-3983477-1002.jpg saved to cache
2025-12-04 10:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 417a6ff8-aba3-55b0-b54f-462a6dc74cf6
2025-12-04 10:05:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce92f50>
2025-12-04 10:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_417a6ff8-aba3-55b0-b54f-462a6dc74cf6/417a6ff8-aba3-55b0-b54f-462a6dc74cf6_image_17.jpg HTTP/1.1" 201 0
2025-12-04 10:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737761-3983477-1003.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737761-3983477-1003.jpg saved to cache
2025-12-04 10:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 417a6ff8-aba3-55b0-b54f-462a6dc74cf6
2025-12-04 10:05:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce90750>
2025-12-04 10:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dbba9f9-5f80-5b85-b53c-7bfc7d08b658/0dbba9f9-5f80-5b85-b53c-7bfc7d08b658_image_7.jpg HTTP/1.1" 201 0
2025-12-04 10:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5f19311e-963e-4d0f-ba66-5d0b7d6a764a_10.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5f19311e-963e-4d0f-ba66-5d0b7d6a764a_10.jpg saved to cache
2025-12-04 10:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0dbba9f9-5f80-5b85-b53c-7bfc7d08b658
2025-12-04 10:05:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6e0690>
2025-12-04 10:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_417a6ff8-aba3-55b0-b54f-462a6dc74cf6/417a6ff8-aba3-55b0-b54f-462a6dc74cf6_image_12.jpg HTTP/1.1" 201 0
2025-12-04 10:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5d248c1a-99e8-479d-9907-c883d119f466_ext_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5d248c1a-99e8-479d-9907-c883d119f466_ext_4.jpg saved to cache
2025-12-04 10:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 417a6ff8-aba3-55b0-b54f-462a6dc74cf6
2025-12-04 10:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5f19311e-963e-4d0f-ba66-5d0b7d6a764a_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737827-01964216-002.pdf)
2025-12-04 10:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3737837-4005180-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737837-01987105-002.pdf)
2025-12-04 10:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5d248c1a-99e8-479d-9907-c883d119f466_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737761-01967847-003.pdf)
2025-12-04 10:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4eb6f4e5-e171-43fa-9c5a-6dca1f62c1d6_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737427-01985255-002.pdf)
2025-12-04 10:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5d248c1a-99e8-479d-9907-c883d119f466_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737761-01967847-003.pdf)
2025-12-04 10:05:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce26890>
2025-12-04 10:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34cde10d-e88c-5c3a-806a-92b38a5272d1/34cde10d-e88c-5c3a-806a-92b38a5272d1_expert_report_file_7ddc7f64-1089-4d83-9b55-0889aa23f093.pdf HTTP/1.1" 201 0
2025-12-04 10:05:36 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 34cde10d-e88c-5c3a-806a-92b38a5272d1
2025-12-04 10:05:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 34cde10d-e88c-5c3a-806a-92b38a5272d1, skipping ID generation
2025-12-04 10:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 34cde10d-e88c-5c3a-806a-92b38a5272d1
2025-12-04 10:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdf7d7138-2b6c-4c32-b01c-6b080211b39d_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/df7d7138-2b6c-4c32-b01c-6b080211b39d_ext_7.jpg not downloaded yet
2025-12-04 10:05:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc58cbd0>
2025-12-04 10:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbf6a261-72e5-58f4-adf3-e63bfe23c322/cbf6a261-72e5-58f4-adf3-e63bfe23c322_image_17.jpg HTTP/1.1" 201 0
2025-12-04 10:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737837-4005180-1003.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737837-4005180-1003.jpg saved to cache
2025-12-04 10:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item cbf6a261-72e5-58f4-adf3-e63bfe23c322
2025-12-04 10:05:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc619a10>
2025-12-04 10:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbf6a261-72e5-58f4-adf3-e63bfe23c322/cbf6a261-72e5-58f4-adf3-e63bfe23c322_image_16.jpg HTTP/1.1" 201 0
2025-12-04 10:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737837-4005180-1002.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737837-4005180-1002.jpg saved to cache
2025-12-04 10:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item cbf6a261-72e5-58f4-adf3-e63bfe23c322
2025-12-04 10:05:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccffd010>
2025-12-04 10:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dbba9f9-5f80-5b85-b53c-7bfc7d08b658/0dbba9f9-5f80-5b85-b53c-7bfc7d08b658_image_6.jpg HTTP/1.1" 201 0
2025-12-04 10:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5f19311e-963e-4d0f-ba66-5d0b7d6a764a_11.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5f19311e-963e-4d0f-ba66-5d0b7d6a764a_11.jpg saved to cache
2025-12-04 10:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0dbba9f9-5f80-5b85-b53c-7bfc7d08b658
2025-12-04 10:05:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf31850>
2025-12-04 10:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dbba9f9-5f80-5b85-b53c-7bfc7d08b658/0dbba9f9-5f80-5b85-b53c-7bfc7d08b658_image_5.jpg HTTP/1.1" 201 0
2025-12-04 10:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5f19311e-963e-4d0f-ba66-5d0b7d6a764a_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5f19311e-963e-4d0f-ba66-5d0b7d6a764a_4.jpg saved to cache
2025-12-04 10:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0dbba9f9-5f80-5b85-b53c-7bfc7d08b658
2025-12-04 10:05:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc61bcd0>
2025-12-04 10:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07143d03-abd8-5a9e-91eb-582acdbfe50b/07143d03-abd8-5a9e-91eb-582acdbfe50b_image_4.jpg HTTP/1.1" 201 0
2025-12-04 10:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4eb6f4e5-e171-43fa-9c5a-6dca1f62c1d6_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4eb6f4e5-e171-43fa-9c5a-6dca1f62c1d6_5.jpg saved to cache
2025-12-04 10:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 07143d03-abd8-5a9e-91eb-582acdbfe50b
2025-12-04 10:05:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccfba190>
2025-12-04 10:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07143d03-abd8-5a9e-91eb-582acdbfe50b/07143d03-abd8-5a9e-91eb-582acdbfe50b_image_3.jpg HTTP/1.1" 201 0
2025-12-04 10:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4eb6f4e5-e171-43fa-9c5a-6dca1f62c1d6_ext_1.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4eb6f4e5-e171-43fa-9c5a-6dca1f62c1d6_ext_1.jpg saved to cache
2025-12-04 10:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 07143d03-abd8-5a9e-91eb-582acdbfe50b
2025-12-04 10:05:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccffd250>
2025-12-04 10:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_417a6ff8-aba3-55b0-b54f-462a6dc74cf6/417a6ff8-aba3-55b0-b54f-462a6dc74cf6_image_11.jpg HTTP/1.1" 201 0
2025-12-04 10:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5d248c1a-99e8-479d-9907-c883d119f466_ext_3.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5d248c1a-99e8-479d-9907-c883d119f466_ext_3.jpg saved to cache
2025-12-04 10:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 417a6ff8-aba3-55b0-b54f-462a6dc74cf6
2025-12-04 10:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdf7d7138-2b6c-4c32-b01c-6b080211b39d_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/df7d7138-2b6c-4c32-b01c-6b080211b39d_ext_7.jpg not downloaded yet
2025-12-04 10:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=3732689&returnUrl=%2Fsearch%3FPage%3D4%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233732689&indx=353> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 10:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdf7d7138-2b6c-4c32-b01c-6b080211b39d_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/df7d7138-2b6c-4c32-b01c-6b080211b39d_ext_6.jpg not downloaded yet
2025-12-04 10:05:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc56c750>
2025-12-04 10:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dbba9f9-5f80-5b85-b53c-7bfc7d08b658/0dbba9f9-5f80-5b85-b53c-7bfc7d08b658_image_4.jpg HTTP/1.1" 201 0
2025-12-04 10:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5f19311e-963e-4d0f-ba66-5d0b7d6a764a_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5f19311e-963e-4d0f-ba66-5d0b7d6a764a_5.jpg saved to cache
2025-12-04 10:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0dbba9f9-5f80-5b85-b53c-7bfc7d08b658
2025-12-04 10:05:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd99a90>
2025-12-04 10:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbf6a261-72e5-58f4-adf3-e63bfe23c322/cbf6a261-72e5-58f4-adf3-e63bfe23c322_image_15.jpg HTTP/1.1" 201 0
2025-12-04 10:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737837-4005180-1001.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737837-4005180-1001.jpg saved to cache
2025-12-04 10:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item cbf6a261-72e5-58f4-adf3-e63bfe23c322
2025-12-04 10:05:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf80890>
2025-12-04 10:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_417a6ff8-aba3-55b0-b54f-462a6dc74cf6/417a6ff8-aba3-55b0-b54f-462a6dc74cf6_image_10.jpg HTTP/1.1" 201 0
2025-12-04 10:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5d248c1a-99e8-479d-9907-c883d119f466_ext_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5d248c1a-99e8-479d-9907-c883d119f466_ext_5.jpg saved to cache
2025-12-04 10:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 417a6ff8-aba3-55b0-b54f-462a6dc74cf6
2025-12-04 10:05:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccec44d0>
2025-12-04 10:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07143d03-abd8-5a9e-91eb-582acdbfe50b/07143d03-abd8-5a9e-91eb-582acdbfe50b_image_2.jpg HTTP/1.1" 201 0
2025-12-04 10:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4eb6f4e5-e171-43fa-9c5a-6dca1f62c1d6_ext_6.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4eb6f4e5-e171-43fa-9c5a-6dca1f62c1d6_ext_6.jpg saved to cache
2025-12-04 10:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 07143d03-abd8-5a9e-91eb-582acdbfe50b
2025-12-04 10:05:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf083d0>
2025-12-04 10:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_417a6ff8-aba3-55b0-b54f-462a6dc74cf6/417a6ff8-aba3-55b0-b54f-462a6dc74cf6_image_9.jpg HTTP/1.1" 201 0
2025-12-04 10:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5d248c1a-99e8-479d-9907-c883d119f466_ext_2.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5d248c1a-99e8-479d-9907-c883d119f466_ext_2.jpg saved to cache
2025-12-04 10:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 417a6ff8-aba3-55b0-b54f-462a6dc74cf6
2025-12-04 10:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdf7d7138-2b6c-4c32-b01c-6b080211b39d_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/df7d7138-2b6c-4c32-b01c-6b080211b39d_ext_1.jpg not downloaded yet
2025-12-04 10:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdf7d7138-2b6c-4c32-b01c-6b080211b39d_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/df7d7138-2b6c-4c32-b01c-6b080211b39d_5.jpg not downloaded yet
2025-12-04 10:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdf7d7138-2b6c-4c32-b01c-6b080211b39d_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/df7d7138-2b6c-4c32-b01c-6b080211b39d_4.jpg not downloaded yet
2025-12-04 10:05:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d41ca17-91a5-5695-a2ce-4ac7d4eea455 with identifier: 3732689
2025-12-04 10:05:39 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 9d41ca17-91a5-5695-a2ce-4ac7d4eea455
2025-12-04 10:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdf7d7138-2b6c-4c32-b01c-6b080211b39d_11.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/df7d7138-2b6c-4c32-b01c-6b080211b39d_11.jpg not downloaded yet
2025-12-04 10:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdf7d7138-2b6c-4c32-b01c-6b080211b39d_10.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/df7d7138-2b6c-4c32-b01c-6b080211b39d_10.jpg not downloaded yet
2025-12-04 10:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdf7d7138-2b6c-4c32-b01c-6b080211b39d_9.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/df7d7138-2b6c-4c32-b01c-6b080211b39d_9.jpg not downloaded yet
2025-12-04 10:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdf7d7138-2b6c-4c32-b01c-6b080211b39d_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/df7d7138-2b6c-4c32-b01c-6b080211b39d_ext_2.jpg not downloaded yet
2025-12-04 10:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdf7d7138-2b6c-4c32-b01c-6b080211b39d_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/df7d7138-2b6c-4c32-b01c-6b080211b39d_ext_5.jpg not downloaded yet
2025-12-04 10:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdf7d7138-2b6c-4c32-b01c-6b080211b39d_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/df7d7138-2b6c-4c32-b01c-6b080211b39d_ext_3.jpg not downloaded yet
2025-12-04 10:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdf7d7138-2b6c-4c32-b01c-6b080211b39d_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/df7d7138-2b6c-4c32-b01c-6b080211b39d_ext_4.jpg not downloaded yet
2025-12-04 10:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737981-4004463-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737981-4004463-13.jpg not downloaded yet
2025-12-04 10:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737981-4004463-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737981-4004463-1000.jpg not downloaded yet
2025-12-04 10:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737981-4004463-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737981-4004463-1001.jpg not downloaded yet
2025-12-04 10:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737981-4004463-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737981-4004463-1002.jpg not downloaded yet
2025-12-04 10:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737981-4004463-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737981-4004463-1003.jpg not downloaded yet
2025-12-04 10:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737981-4004463-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737981-4004463-1004.jpg not downloaded yet
2025-12-04 10:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737981-4004463-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737981-4004463-1005.jpg not downloaded yet
2025-12-04 10:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3737981-4004463-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737981-01982662-003.pdf)
2025-12-04 10:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3737981-4004463-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737981-01982662-003.pdf)
2025-12-04 10:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3737981-4004463-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737981-01982662-003.pdf)
2025-12-04 10:05:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce2f550>
2025-12-04 10:05:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34cde10d-e88c-5c3a-806a-92b38a5272d1/34cde10d-e88c-5c3a-806a-92b38a5272d1_image_19.jpg HTTP/1.1" 201 0
2025-12-04 10:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737981-4004463-1005.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737981-4004463-1005.jpg saved to cache
2025-12-04 10:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 34cde10d-e88c-5c3a-806a-92b38a5272d1
2025-12-04 10:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3737981-4004463-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737981-01982662-003.pdf)
2025-12-04 10:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/df7d7138-2b6c-4c32-b01c-6b080211b39d_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737981-01982662-003.pdf)
2025-12-04 10:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3737981-4004463-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737981-01982662-003.pdf)
2025-12-04 10:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/df7d7138-2b6c-4c32-b01c-6b080211b39d_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737981-01982662-003.pdf)
2025-12-04 10:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/df7d7138-2b6c-4c32-b01c-6b080211b39d_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737981-01982662-003.pdf)
2025-12-04 10:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/df7d7138-2b6c-4c32-b01c-6b080211b39d_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737981-01982662-003.pdf)
2025-12-04 10:05:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6f3850>
2025-12-04 10:05:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34cde10d-e88c-5c3a-806a-92b38a5272d1/34cde10d-e88c-5c3a-806a-92b38a5272d1_image_14.jpg HTTP/1.1" 201 0
2025-12-04 10:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737981-4004463-1000.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737981-4004463-1000.jpg saved to cache
2025-12-04 10:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 34cde10d-e88c-5c3a-806a-92b38a5272d1
2025-12-04 10:05:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6f8450>
2025-12-04 10:05:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34cde10d-e88c-5c3a-806a-92b38a5272d1/34cde10d-e88c-5c3a-806a-92b38a5272d1_image_17.jpg HTTP/1.1" 201 0
2025-12-04 10:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737981-4004463-1003.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737981-4004463-1003.jpg saved to cache
2025-12-04 10:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 34cde10d-e88c-5c3a-806a-92b38a5272d1
2025-12-04 10:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3737981-4004463-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737981-01982662-003.pdf)
2025-12-04 10:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3737981-4004463-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737981-01982662-003.pdf)
2025-12-04 10:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/df7d7138-2b6c-4c32-b01c-6b080211b39d_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737981-01982662-003.pdf)
2025-12-04 10:05:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce00210>
2025-12-04 10:05:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34cde10d-e88c-5c3a-806a-92b38a5272d1/34cde10d-e88c-5c3a-806a-92b38a5272d1_image_18.jpg HTTP/1.1" 201 0
2025-12-04 10:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737981-4004463-1004.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737981-4004463-1004.jpg saved to cache
2025-12-04 10:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 34cde10d-e88c-5c3a-806a-92b38a5272d1
2025-12-04 10:05:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6b6150>
2025-12-04 10:05:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34cde10d-e88c-5c3a-806a-92b38a5272d1/34cde10d-e88c-5c3a-806a-92b38a5272d1_image_10.jpg HTTP/1.1" 201 0
2025-12-04 10:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdf7d7138-2b6c-4c32-b01c-6b080211b39d_ext_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/df7d7138-2b6c-4c32-b01c-6b080211b39d_ext_5.jpg saved to cache
2025-12-04 10:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 34cde10d-e88c-5c3a-806a-92b38a5272d1
2025-12-04 10:05:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc596710>
2025-12-04 10:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34cde10d-e88c-5c3a-806a-92b38a5272d1/34cde10d-e88c-5c3a-806a-92b38a5272d1_image_13.jpg HTTP/1.1" 201 0
2025-12-04 10:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737981-4004463-13.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737981-4004463-13.jpg saved to cache
2025-12-04 10:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 34cde10d-e88c-5c3a-806a-92b38a5272d1
2025-12-04 10:05:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc594410>
2025-12-04 10:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34cde10d-e88c-5c3a-806a-92b38a5272d1/34cde10d-e88c-5c3a-806a-92b38a5272d1_image_12.jpg HTTP/1.1" 201 0
2025-12-04 10:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdf7d7138-2b6c-4c32-b01c-6b080211b39d_ext_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/df7d7138-2b6c-4c32-b01c-6b080211b39d_ext_4.jpg saved to cache
2025-12-04 10:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 34cde10d-e88c-5c3a-806a-92b38a5272d1
2025-12-04 10:05:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc596190>
2025-12-04 10:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34cde10d-e88c-5c3a-806a-92b38a5272d1/34cde10d-e88c-5c3a-806a-92b38a5272d1_image_11.jpg HTTP/1.1" 201 0
2025-12-04 10:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdf7d7138-2b6c-4c32-b01c-6b080211b39d_ext_3.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/df7d7138-2b6c-4c32-b01c-6b080211b39d_ext_3.jpg saved to cache
2025-12-04 10:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 34cde10d-e88c-5c3a-806a-92b38a5272d1
2025-12-04 10:05:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc61b0d0>
2025-12-04 10:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34cde10d-e88c-5c3a-806a-92b38a5272d1/34cde10d-e88c-5c3a-806a-92b38a5272d1_image_9.jpg HTTP/1.1" 201 0
2025-12-04 10:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdf7d7138-2b6c-4c32-b01c-6b080211b39d_ext_2.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/df7d7138-2b6c-4c32-b01c-6b080211b39d_ext_2.jpg saved to cache
2025-12-04 10:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 34cde10d-e88c-5c3a-806a-92b38a5272d1
2025-12-04 10:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/df7d7138-2b6c-4c32-b01c-6b080211b39d_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737981-01982662-003.pdf)
2025-12-04 10:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/df7d7138-2b6c-4c32-b01c-6b080211b39d_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737981-01982662-003.pdf)
2025-12-04 10:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/df7d7138-2b6c-4c32-b01c-6b080211b39d_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737981-01982662-003.pdf)
2025-12-04 10:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/df7d7138-2b6c-4c32-b01c-6b080211b39d_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737981-01982662-003.pdf)
2025-12-04 10:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/df7d7138-2b6c-4c32-b01c-6b080211b39d_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737981-01982662-003.pdf)
2025-12-04 10:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/df7d7138-2b6c-4c32-b01c-6b080211b39d_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737981-01982662-003.pdf)
2025-12-04 10:05:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc61ab10>
2025-12-04 10:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34cde10d-e88c-5c3a-806a-92b38a5272d1/34cde10d-e88c-5c3a-806a-92b38a5272d1_image_15.jpg HTTP/1.1" 201 0
2025-12-04 10:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737981-4004463-1001.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737981-4004463-1001.jpg saved to cache
2025-12-04 10:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 34cde10d-e88c-5c3a-806a-92b38a5272d1
2025-12-04 10:05:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce64cd0>
2025-12-04 10:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34cde10d-e88c-5c3a-806a-92b38a5272d1/34cde10d-e88c-5c3a-806a-92b38a5272d1_image_16.jpg HTTP/1.1" 201 0
2025-12-04 10:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737981-4004463-1002.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737981-4004463-1002.jpg saved to cache
2025-12-04 10:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 34cde10d-e88c-5c3a-806a-92b38a5272d1
2025-12-04 10:05:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc53e290>
2025-12-04 10:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34cde10d-e88c-5c3a-806a-92b38a5272d1/34cde10d-e88c-5c3a-806a-92b38a5272d1_image_7.jpg HTTP/1.1" 201 0
2025-12-04 10:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdf7d7138-2b6c-4c32-b01c-6b080211b39d_10.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/df7d7138-2b6c-4c32-b01c-6b080211b39d_10.jpg saved to cache
2025-12-04 10:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 34cde10d-e88c-5c3a-806a-92b38a5272d1
2025-12-04 10:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/df7d7138-2b6c-4c32-b01c-6b080211b39d_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737981-01982662-003.pdf)
2025-12-04 10:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4eb6f4e5-e171-43fa-9c5a-6dca1f62c1d6_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737427-01985255-002.pdf)
2025-12-04 10:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3737837-4005180-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737837-01987105-002.pdf)
2025-12-04 10:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/df7d7138-2b6c-4c32-b01c-6b080211b39d_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737981-01982662-003.pdf)
2025-12-04 10:05:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd0f49d0>
2025-12-04 10:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34cde10d-e88c-5c3a-806a-92b38a5272d1/34cde10d-e88c-5c3a-806a-92b38a5272d1_image_8.jpg HTTP/1.1" 201 0
2025-12-04 10:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdf7d7138-2b6c-4c32-b01c-6b080211b39d_9.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/df7d7138-2b6c-4c32-b01c-6b080211b39d_9.jpg saved to cache
2025-12-04 10:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 34cde10d-e88c-5c3a-806a-92b38a5272d1
2025-12-04 10:05:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc698190>
2025-12-04 10:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34cde10d-e88c-5c3a-806a-92b38a5272d1/34cde10d-e88c-5c3a-806a-92b38a5272d1_image_3.jpg HTTP/1.1" 201 0
2025-12-04 10:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdf7d7138-2b6c-4c32-b01c-6b080211b39d_ext_1.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/df7d7138-2b6c-4c32-b01c-6b080211b39d_ext_1.jpg saved to cache
2025-12-04 10:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 34cde10d-e88c-5c3a-806a-92b38a5272d1
2025-12-04 10:05:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6f8050>
2025-12-04 10:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34cde10d-e88c-5c3a-806a-92b38a5272d1/34cde10d-e88c-5c3a-806a-92b38a5272d1_image_5.jpg HTTP/1.1" 201 0
2025-12-04 10:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdf7d7138-2b6c-4c32-b01c-6b080211b39d_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/df7d7138-2b6c-4c32-b01c-6b080211b39d_4.jpg saved to cache
2025-12-04 10:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 34cde10d-e88c-5c3a-806a-92b38a5272d1
2025-12-04 10:05:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccefd350>
2025-12-04 10:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 10:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34cde10d-e88c-5c3a-806a-92b38a5272d1/34cde10d-e88c-5c3a-806a-92b38a5272d1_image_2.jpg HTTP/1.1" 201 0
2025-12-04 10:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdf7d7138-2b6c-4c32-b01c-6b080211b39d_ext_6.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/df7d7138-2b6c-4c32-b01c-6b080211b39d_ext_6.jpg saved to cache
2025-12-04 10:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 34cde10d-e88c-5c3a-806a-92b38a5272d1
2025-12-04 10:05:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf16010>
2025-12-04 10:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34cde10d-e88c-5c3a-806a-92b38a5272d1/34cde10d-e88c-5c3a-806a-92b38a5272d1_image_1.jpg HTTP/1.1" 201 0
2025-12-04 10:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdf7d7138-2b6c-4c32-b01c-6b080211b39d_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/df7d7138-2b6c-4c32-b01c-6b080211b39d_ext_7.jpg saved to cache
2025-12-04 10:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 34cde10d-e88c-5c3a-806a-92b38a5272d1
2025-12-04 10:05:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd0f5e90>
2025-12-04 10:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 10:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34cde10d-e88c-5c3a-806a-92b38a5272d1/34cde10d-e88c-5c3a-806a-92b38a5272d1_image_6.jpg HTTP/1.1" 201 0
2025-12-04 10:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdf7d7138-2b6c-4c32-b01c-6b080211b39d_11.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/df7d7138-2b6c-4c32-b01c-6b080211b39d_11.jpg saved to cache
2025-12-04 10:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 34cde10d-e88c-5c3a-806a-92b38a5272d1
2025-12-04 10:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3737837-4005180-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737837-01987105-002.pdf)
2025-12-04 10:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/PEUGEOT/3008?id=3733108&returnUrl=%2Fsearch%3FPage%3D4%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233733108&indx=354> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 10:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4eb6f4e5-e171-43fa-9c5a-6dca1f62c1d6_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737427-01985255-002.pdf)
2025-12-04 10:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5d248c1a-99e8-479d-9907-c883d119f466_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737761-01967847-003.pdf)
2025-12-04 10:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5f19311e-963e-4d0f-ba66-5d0b7d6a764a_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737827-01964216-002.pdf)
2025-12-04 10:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5f19311e-963e-4d0f-ba66-5d0b7d6a764a_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737827-01964216-002.pdf)
2025-12-04 10:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5d248c1a-99e8-479d-9907-c883d119f466_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737761-01967847-003.pdf)
2025-12-04 10:05:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccc75890>
2025-12-04 10:05:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34cde10d-e88c-5c3a-806a-92b38a5272d1/34cde10d-e88c-5c3a-806a-92b38a5272d1_image_4.jpg HTTP/1.1" 201 0
2025-12-04 10:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdf7d7138-2b6c-4c32-b01c-6b080211b39d_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/df7d7138-2b6c-4c32-b01c-6b080211b39d_5.jpg saved to cache
2025-12-04 10:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 34cde10d-e88c-5c3a-806a-92b38a5272d1
2025-12-04 10:05:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc58fc90>
2025-12-04 10:05:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07143d03-abd8-5a9e-91eb-582acdbfe50b/07143d03-abd8-5a9e-91eb-582acdbfe50b_image_1.jpg HTTP/1.1" 201 0
2025-12-04 10:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4eb6f4e5-e171-43fa-9c5a-6dca1f62c1d6_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4eb6f4e5-e171-43fa-9c5a-6dca1f62c1d6_ext_7.jpg saved to cache
2025-12-04 10:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 07143d03-abd8-5a9e-91eb-582acdbfe50b
2025-12-04 10:05:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6d7a90>
2025-12-04 10:05:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbf6a261-72e5-58f4-adf3-e63bfe23c322/cbf6a261-72e5-58f4-adf3-e63bfe23c322_image_14.jpg HTTP/1.1" 201 0
2025-12-04 10:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737837-4005180-1000.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737837-4005180-1000.jpg saved to cache
2025-12-04 10:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item cbf6a261-72e5-58f4-adf3-e63bfe23c322
2025-12-04 10:05:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce64c90>
2025-12-04 10:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34cde10d-e88c-5c3a-806a-92b38a5272d1/34cde10d-e88c-5c3a-806a-92b38a5272d1_image_0.jpg HTTP/1.1" 201 0
2025-12-04 10:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdf7d7138-2b6c-4c32-b01c-6b080211b39d_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/df7d7138-2b6c-4c32-b01c-6b080211b39d_ext_7.jpg saved to cache
2025-12-04 10:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 34cde10d-e88c-5c3a-806a-92b38a5272d1
2025-12-04 10:05:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 34cde10d-e88c-5c3a-806a-92b38a5272d1, skipping ID generation
2025-12-04 10:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 34cde10d-e88c-5c3a-806a-92b38a5272d1 from tracking dictionaries
2025-12-04 10:05:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 34cde10d-e88c-5c3a-806a-92b38a5272d1 sending to next pipeline
2025-12-04 10:05:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 34cde10d-e88c-5c3a-806a-92b38a5272d1, identifier: 3737981
2025-12-04 10:05:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 34cde10d-e88c-5c3a-806a-92b38a5272d1 with identifier: 3737981
2025-12-04 10:05:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 34cde10d-e88c-5c3a-806a-92b38a5272d1 with identifier: 3737981
2025-12-04 10:05:48 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 34cde10d-e88c-5c3a-806a-92b38a5272d1 with identifier: 3737981 to the API
2025-12-04 10:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 10:05:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 10:05:48 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/df7d7138-2b6c-4c32-b01c-6b080211b39d_ext_7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 36,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34cde10d-e88c-5c3a-806a-92b38a5272d1/34cde10d-e88c-5c3a-806a-92b38a5272d1_expert_report_file_7ddc7f64-1089-4d83-9b55-0889aa23f093.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003737981-01982662-003.pdf',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Petrol/Hybrid',
 'id': '34cde10d-e88c-5c3a-806a-92b38a5272d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'HT21JUO',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/BMW/3%20SERIES?id=3737981',
 'listing': 'auction',
 'location': 'Bristol',
 'make': 'BMW',
 'model': '3 SERIES',
 'odometer': 88461,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 54,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34cde10d-e88c-5c3a-806a-92b38a5272d1/34cde10d-e88c-5c3a-806a-92b38a5272d1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 243499,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/df7d7138-2b6c-4c32-b01c-6b080211b39d_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34cde10d-e88c-5c3a-806a-92b38a5272d1/34cde10d-e88c-5c3a-806a-92b38a5272d1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 243499,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/df7d7138-2b6c-4c32-b01c-6b080211b39d_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34cde10d-e88c-5c3a-806a-92b38a5272d1/34cde10d-e88c-5c3a-806a-92b38a5272d1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 227393,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/df7d7138-2b6c-4c32-b01c-6b080211b39d_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34cde10d-e88c-5c3a-806a-92b38a5272d1/34cde10d-e88c-5c3a-806a-92b38a5272d1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 169891,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/df7d7138-2b6c-4c32-b01c-6b080211b39d_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34cde10d-e88c-5c3a-806a-92b38a5272d1/34cde10d-e88c-5c3a-806a-92b38a5272d1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 264011,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/df7d7138-2b6c-4c32-b01c-6b080211b39d_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34cde10d-e88c-5c3a-806a-92b38a5272d1/34cde10d-e88c-5c3a-806a-92b38a5272d1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 223037,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/df7d7138-2b6c-4c32-b01c-6b080211b39d_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34cde10d-e88c-5c3a-806a-92b38a5272d1/34cde10d-e88c-5c3a-806a-92b38a5272d1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 258178,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/df7d7138-2b6c-4c32-b01c-6b080211b39d_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34cde10d-e88c-5c3a-806a-92b38a5272d1/34cde10d-e88c-5c3a-806a-92b38a5272d1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 229534,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/df7d7138-2b6c-4c32-b01c-6b080211b39d_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34cde10d-e88c-5c3a-806a-92b38a5272d1/34cde10d-e88c-5c3a-806a-92b38a5272d1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 267989,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/df7d7138-2b6c-4c32-b01c-6b080211b39d_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34cde10d-e88c-5c3a-806a-92b38a5272d1/34cde10d-e88c-5c3a-806a-92b38a5272d1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 235995,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/df7d7138-2b6c-4c32-b01c-6b080211b39d_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34cde10d-e88c-5c3a-806a-92b38a5272d1/34cde10d-e88c-5c3a-806a-92b38a5272d1_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 187847,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/df7d7138-2b6c-4c32-b01c-6b080211b39d_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34cde10d-e88c-5c3a-806a-92b38a5272d1/34cde10d-e88c-5c3a-806a-92b38a5272d1_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 204292,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/df7d7138-2b6c-4c32-b01c-6b080211b39d_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34cde10d-e88c-5c3a-806a-92b38a5272d1/34cde10d-e88c-5c3a-806a-92b38a5272d1_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 200545,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/df7d7138-2b6c-4c32-b01c-6b080211b39d_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34cde10d-e88c-5c3a-806a-92b38a5272d1/34cde10d-e88c-5c3a-806a-92b38a5272d1_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 268873,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3737981-4004463-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34cde10d-e88c-5c3a-806a-92b38a5272d1/34cde10d-e88c-5c3a-806a-92b38a5272d1_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 281018,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3737981-4004463-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34cde10d-e88c-5c3a-806a-92b38a5272d1/34cde10d-e88c-5c3a-806a-92b38a5272d1_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 392891,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3737981-4004463-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34cde10d-e88c-5c3a-806a-92b38a5272d1/34cde10d-e88c-5c3a-806a-92b38a5272d1_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 379091,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3737981-4004463-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34cde10d-e88c-5c3a-806a-92b38a5272d1/34cde10d-e88c-5c3a-806a-92b38a5272d1_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 320719,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3737981-4004463-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34cde10d-e88c-5c3a-806a-92b38a5272d1/34cde10d-e88c-5c3a-806a-92b38a5272d1_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 348924,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3737981-4004463-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34cde10d-e88c-5c3a-806a-92b38a5272d1/34cde10d-e88c-5c3a-806a-92b38a5272d1_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 219961,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3737981-4004463-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-22',
 'seller_name': 'Novuna Vehicle Solutions',
 'title': 'BMW 3 SERIES 330e xDrive M Sport 4dr Step Auto',
 'transmission': 'automatic',
 'trim': '330e xDrive M Sport 4dr Step Auto',
 'year': 2021}
2025-12-04 10:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273737981%27 HTTP/1.1" 200 None
2025-12-04 10:05:48 [manheim.gb] INFO: Saving data for 3737981: {'created_time': 1764842748.917897, 'last_price_update_time': 1764842748.917907, 'auction_closing_time': 1765270800.0}
2025-12-04 10:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3737981') HTTP/1.1" 204 0
2025-12-04 10:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5f19311e-963e-4d0f-ba66-5d0b7d6a764a_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737827-01964216-002.pdf)
2025-12-04 10:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7787796d-09e9-45c7-9633-610d7ed6024b_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737837-01987105-002.pdf)
2025-12-04 10:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5d248c1a-99e8-479d-9907-c883d119f466_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737761-01967847-003.pdf)
2025-12-04 10:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5f19311e-963e-4d0f-ba66-5d0b7d6a764a_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737827-01964216-002.pdf)
2025-12-04 10:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7787796d-09e9-45c7-9633-610d7ed6024b_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737837-01987105-002.pdf)
2025-12-04 10:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7787796d-09e9-45c7-9633-610d7ed6024b_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737837-01987105-002.pdf)
2025-12-04 10:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5d248c1a-99e8-479d-9907-c883d119f466_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737761-01967847-003.pdf)
2025-12-04 10:05:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf917d0>
2025-12-04 10:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbf6a261-72e5-58f4-adf3-e63bfe23c322/cbf6a261-72e5-58f4-adf3-e63bfe23c322_image_13.jpg HTTP/1.1" 201 0
2025-12-04 10:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737837-4005180-13.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737837-4005180-13.jpg saved to cache
2025-12-04 10:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item cbf6a261-72e5-58f4-adf3-e63bfe23c322
2025-12-04 10:05:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 280bb43a-4e12-593b-bbeb-807f0c52302f with identifier: 3733108
2025-12-04 10:05:49 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 280bb43a-4e12-593b-bbeb-807f0c52302f
2025-12-04 10:05:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccfe33d0>
2025-12-04 10:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07143d03-abd8-5a9e-91eb-582acdbfe50b/07143d03-abd8-5a9e-91eb-582acdbfe50b_image_0.jpg HTTP/1.1" 201 0
2025-12-04 10:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4eb6f4e5-e171-43fa-9c5a-6dca1f62c1d6_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4eb6f4e5-e171-43fa-9c5a-6dca1f62c1d6_ext_7.jpg saved to cache
2025-12-04 10:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 07143d03-abd8-5a9e-91eb-582acdbfe50b
2025-12-04 10:05:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 07143d03-abd8-5a9e-91eb-582acdbfe50b, skipping ID generation
2025-12-04 10:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 07143d03-abd8-5a9e-91eb-582acdbfe50b from tracking dictionaries
2025-12-04 10:05:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 07143d03-abd8-5a9e-91eb-582acdbfe50b sending to next pipeline
2025-12-04 10:05:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 07143d03-abd8-5a9e-91eb-582acdbfe50b, identifier: 3737427
2025-12-04 10:05:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cccd96d0>
2025-12-04 10:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_417a6ff8-aba3-55b0-b54f-462a6dc74cf6/417a6ff8-aba3-55b0-b54f-462a6dc74cf6_image_8.jpg HTTP/1.1" 201 0
2025-12-04 10:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5d248c1a-99e8-479d-9907-c883d119f466_9.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5d248c1a-99e8-479d-9907-c883d119f466_9.jpg saved to cache
2025-12-04 10:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 417a6ff8-aba3-55b0-b54f-462a6dc74cf6
2025-12-04 10:05:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5c0610>
2025-12-04 10:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dbba9f9-5f80-5b85-b53c-7bfc7d08b658/0dbba9f9-5f80-5b85-b53c-7bfc7d08b658_image_2.jpg HTTP/1.1" 201 0
2025-12-04 10:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5f19311e-963e-4d0f-ba66-5d0b7d6a764a_ext_6.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5f19311e-963e-4d0f-ba66-5d0b7d6a764a_ext_6.jpg saved to cache
2025-12-04 10:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0dbba9f9-5f80-5b85-b53c-7bfc7d08b658
2025-12-04 10:05:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf92d90>
2025-12-04 10:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dbba9f9-5f80-5b85-b53c-7bfc7d08b658/0dbba9f9-5f80-5b85-b53c-7bfc7d08b658_image_3.jpg HTTP/1.1" 201 0
2025-12-04 10:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5f19311e-963e-4d0f-ba66-5d0b7d6a764a_ext_1.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5f19311e-963e-4d0f-ba66-5d0b7d6a764a_ext_1.jpg saved to cache
2025-12-04 10:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0dbba9f9-5f80-5b85-b53c-7bfc7d08b658
2025-12-04 10:05:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccc83990>
2025-12-04 10:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_417a6ff8-aba3-55b0-b54f-462a6dc74cf6/417a6ff8-aba3-55b0-b54f-462a6dc74cf6_image_7.jpg HTTP/1.1" 201 0
2025-12-04 10:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5d248c1a-99e8-479d-9907-c883d119f466_10.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5d248c1a-99e8-479d-9907-c883d119f466_10.jpg saved to cache
2025-12-04 10:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 417a6ff8-aba3-55b0-b54f-462a6dc74cf6
2025-12-04 10:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5d248c1a-99e8-479d-9907-c883d119f466_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737761-01967847-003.pdf)
2025-12-04 10:05:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 07143d03-abd8-5a9e-91eb-582acdbfe50b with identifier: 3737427
2025-12-04 10:05:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 07143d03-abd8-5a9e-91eb-582acdbfe50b with identifier: 3737427
2025-12-04 10:05:50 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 07143d03-abd8-5a9e-91eb-582acdbfe50b with identifier: 3737427 to the API
2025-12-04 10:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 10:05:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 10:05:51 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/4eb6f4e5-e171-43fa-9c5a-6dca1f62c1d6_ext_7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07143d03-abd8-5a9e-91eb-582acdbfe50b/07143d03-abd8-5a9e-91eb-582acdbfe50b_expert_report_file_e5c59b2c-406c-4ef8-858e-b1af72f1cb37.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003737427-01985255-002.pdf',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '1.0L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '07143d03-abd8-5a9e-91eb-582acdbfe50b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'YH71OYG',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/AUDI/A1?id=3737427',
 'listing': 'auction',
 'location': 'Leeds - In Transit',
 'make': 'AUDI',
 'model': 'A1',
 'odometer': 32461,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07143d03-abd8-5a9e-91eb-582acdbfe50b/07143d03-abd8-5a9e-91eb-582acdbfe50b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 191329,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4eb6f4e5-e171-43fa-9c5a-6dca1f62c1d6_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07143d03-abd8-5a9e-91eb-582acdbfe50b/07143d03-abd8-5a9e-91eb-582acdbfe50b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 191329,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4eb6f4e5-e171-43fa-9c5a-6dca1f62c1d6_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07143d03-abd8-5a9e-91eb-582acdbfe50b/07143d03-abd8-5a9e-91eb-582acdbfe50b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 159087,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4eb6f4e5-e171-43fa-9c5a-6dca1f62c1d6_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07143d03-abd8-5a9e-91eb-582acdbfe50b/07143d03-abd8-5a9e-91eb-582acdbfe50b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 166055,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4eb6f4e5-e171-43fa-9c5a-6dca1f62c1d6_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07143d03-abd8-5a9e-91eb-582acdbfe50b/07143d03-abd8-5a9e-91eb-582acdbfe50b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 177651,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4eb6f4e5-e171-43fa-9c5a-6dca1f62c1d6_5.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07143d03-abd8-5a9e-91eb-582acdbfe50b/07143d03-abd8-5a9e-91eb-582acdbfe50b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 192401,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4eb6f4e5-e171-43fa-9c5a-6dca1f62c1d6_4.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07143d03-abd8-5a9e-91eb-582acdbfe50b/07143d03-abd8-5a9e-91eb-582acdbfe50b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 183119,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4eb6f4e5-e171-43fa-9c5a-6dca1f62c1d6_11.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07143d03-abd8-5a9e-91eb-582acdbfe50b/07143d03-abd8-5a9e-91eb-582acdbfe50b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 201265,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4eb6f4e5-e171-43fa-9c5a-6dca1f62c1d6_10.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07143d03-abd8-5a9e-91eb-582acdbfe50b/07143d03-abd8-5a9e-91eb-582acdbfe50b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 205844,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4eb6f4e5-e171-43fa-9c5a-6dca1f62c1d6_9.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07143d03-abd8-5a9e-91eb-582acdbfe50b/07143d03-abd8-5a9e-91eb-582acdbfe50b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 178254,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4eb6f4e5-e171-43fa-9c5a-6dca1f62c1d6_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07143d03-abd8-5a9e-91eb-582acdbfe50b/07143d03-abd8-5a9e-91eb-582acdbfe50b_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 159169,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4eb6f4e5-e171-43fa-9c5a-6dca1f62c1d6_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07143d03-abd8-5a9e-91eb-582acdbfe50b/07143d03-abd8-5a9e-91eb-582acdbfe50b_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 140110,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4eb6f4e5-e171-43fa-9c5a-6dca1f62c1d6_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07143d03-abd8-5a9e-91eb-582acdbfe50b/07143d03-abd8-5a9e-91eb-582acdbfe50b_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 219523,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4eb6f4e5-e171-43fa-9c5a-6dca1f62c1d6_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07143d03-abd8-5a9e-91eb-582acdbfe50b/07143d03-abd8-5a9e-91eb-582acdbfe50b_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 336092,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3737427-4004763-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07143d03-abd8-5a9e-91eb-582acdbfe50b/07143d03-abd8-5a9e-91eb-582acdbfe50b_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95542,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3737427-4004763-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07143d03-abd8-5a9e-91eb-582acdbfe50b/07143d03-abd8-5a9e-91eb-582acdbfe50b_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 164252,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3737427-4004763-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07143d03-abd8-5a9e-91eb-582acdbfe50b/07143d03-abd8-5a9e-91eb-582acdbfe50b_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 243502,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3737427-4004763-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07143d03-abd8-5a9e-91eb-582acdbfe50b/07143d03-abd8-5a9e-91eb-582acdbfe50b_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 291667,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3737427-4004763-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07143d03-abd8-5a9e-91eb-582acdbfe50b/07143d03-abd8-5a9e-91eb-582acdbfe50b_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 246213,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3737427-4004763-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07143d03-abd8-5a9e-91eb-582acdbfe50b/07143d03-abd8-5a9e-91eb-582acdbfe50b_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 256719,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3737427-4004763-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-20',
 'seller_name': 'Novuna Vehicle Solutions',
 'title': 'AUDI A1 25 TFSI Technik 5dr',
 'transmission': 'manual',
 'trim': '25 TFSI Technik 5dr',
 'year': 2022}
2025-12-04 10:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273737427%27 HTTP/1.1" 200 None
2025-12-04 10:05:51 [manheim.gb] INFO: Saving data for 3737427: {'created_time': 1764842751.1953, 'last_price_update_time': 1764842751.195309, 'auction_closing_time': 1765184400.0}
2025-12-04 10:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3737427') HTTP/1.1" 204 0
2025-12-04 10:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7787796d-09e9-45c7-9633-610d7ed6024b_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737837-01987105-002.pdf)
2025-12-04 10:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5d248c1a-99e8-479d-9907-c883d119f466_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737761-01967847-003.pdf)
2025-12-04 10:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5d248c1a-99e8-479d-9907-c883d119f466_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737761-01967847-003.pdf)
2025-12-04 10:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7787796d-09e9-45c7-9633-610d7ed6024b_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737837-01987105-002.pdf)
2025-12-04 10:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7787796d-09e9-45c7-9633-610d7ed6024b_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737837-01987105-002.pdf)
2025-12-04 10:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7787796d-09e9-45c7-9633-610d7ed6024b_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737837-01987105-002.pdf)
2025-12-04 10:05:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5f7610>
2025-12-04 10:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dbba9f9-5f80-5b85-b53c-7bfc7d08b658/0dbba9f9-5f80-5b85-b53c-7bfc7d08b658_image_1.jpg HTTP/1.1" 201 0
2025-12-04 10:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5f19311e-963e-4d0f-ba66-5d0b7d6a764a_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5f19311e-963e-4d0f-ba66-5d0b7d6a764a_ext_7.jpg saved to cache
2025-12-04 10:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0dbba9f9-5f80-5b85-b53c-7bfc7d08b658
2025-12-04 10:05:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc7e7c50>
2025-12-04 10:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbf6a261-72e5-58f4-adf3-e63bfe23c322/cbf6a261-72e5-58f4-adf3-e63bfe23c322_image_11.jpg HTTP/1.1" 201 0
2025-12-04 10:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7787796d-09e9-45c7-9633-610d7ed6024b_ext_3.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7787796d-09e9-45c7-9633-610d7ed6024b_ext_3.jpg saved to cache
2025-12-04 10:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item cbf6a261-72e5-58f4-adf3-e63bfe23c322
2025-12-04 10:05:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf682d0>
2025-12-04 10:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_417a6ff8-aba3-55b0-b54f-462a6dc74cf6/417a6ff8-aba3-55b0-b54f-462a6dc74cf6_image_6.jpg HTTP/1.1" 201 0
2025-12-04 10:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5d248c1a-99e8-479d-9907-c883d119f466_11.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5d248c1a-99e8-479d-9907-c883d119f466_11.jpg saved to cache
2025-12-04 10:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 417a6ff8-aba3-55b0-b54f-462a6dc74cf6
2025-12-04 10:05:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccef0f90>
2025-12-04 10:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dbba9f9-5f80-5b85-b53c-7bfc7d08b658/0dbba9f9-5f80-5b85-b53c-7bfc7d08b658_image_0.jpg HTTP/1.1" 201 0
2025-12-04 10:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5f19311e-963e-4d0f-ba66-5d0b7d6a764a_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5f19311e-963e-4d0f-ba66-5d0b7d6a764a_ext_7.jpg saved to cache
2025-12-04 10:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0dbba9f9-5f80-5b85-b53c-7bfc7d08b658
2025-12-04 10:05:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0dbba9f9-5f80-5b85-b53c-7bfc7d08b658, skipping ID generation
2025-12-04 10:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 0dbba9f9-5f80-5b85-b53c-7bfc7d08b658 from tracking dictionaries
2025-12-04 10:05:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0dbba9f9-5f80-5b85-b53c-7bfc7d08b658 sending to next pipeline
2025-12-04 10:05:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 0dbba9f9-5f80-5b85-b53c-7bfc7d08b658, identifier: 3737827
2025-12-04 10:05:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccef0c90>
2025-12-04 10:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbf6a261-72e5-58f4-adf3-e63bfe23c322/cbf6a261-72e5-58f4-adf3-e63bfe23c322_image_12.jpg HTTP/1.1" 201 0
2025-12-04 10:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7787796d-09e9-45c7-9633-610d7ed6024b_ext_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7787796d-09e9-45c7-9633-610d7ed6024b_ext_4.jpg saved to cache
2025-12-04 10:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item cbf6a261-72e5-58f4-adf3-e63bfe23c322
2025-12-04 10:05:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5f5310>
2025-12-04 10:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbf6a261-72e5-58f4-adf3-e63bfe23c322/cbf6a261-72e5-58f4-adf3-e63bfe23c322_image_10.jpg HTTP/1.1" 201 0
2025-12-04 10:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7787796d-09e9-45c7-9633-610d7ed6024b_ext_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7787796d-09e9-45c7-9633-610d7ed6024b_ext_5.jpg saved to cache
2025-12-04 10:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item cbf6a261-72e5-58f4-adf3-e63bfe23c322
2025-12-04 10:05:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd063750>
2025-12-04 10:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_417a6ff8-aba3-55b0-b54f-462a6dc74cf6/417a6ff8-aba3-55b0-b54f-462a6dc74cf6_image_4.jpg HTTP/1.1" 201 0
2025-12-04 10:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5d248c1a-99e8-479d-9907-c883d119f466_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5d248c1a-99e8-479d-9907-c883d119f466_5.jpg saved to cache
2025-12-04 10:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 417a6ff8-aba3-55b0-b54f-462a6dc74cf6
2025-12-04 10:05:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc59f910>
2025-12-04 10:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_417a6ff8-aba3-55b0-b54f-462a6dc74cf6/417a6ff8-aba3-55b0-b54f-462a6dc74cf6_image_5.jpg HTTP/1.1" 201 0
2025-12-04 10:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5d248c1a-99e8-479d-9907-c883d119f466_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5d248c1a-99e8-479d-9907-c883d119f466_4.jpg saved to cache
2025-12-04 10:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 417a6ff8-aba3-55b0-b54f-462a6dc74cf6
2025-12-04 10:05:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 0dbba9f9-5f80-5b85-b53c-7bfc7d08b658 with identifier: 3737827
2025-12-04 10:05:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 0dbba9f9-5f80-5b85-b53c-7bfc7d08b658 with identifier: 3737827
2025-12-04 10:05:53 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 0dbba9f9-5f80-5b85-b53c-7bfc7d08b658 with identifier: 3737827 to the API
2025-12-04 10:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 10:05:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 10:05:53 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/5f19311e-963e-4d0f-ba66-5d0b7d6a764a_ext_7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 161,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dbba9f9-5f80-5b85-b53c-7bfc7d08b658/0dbba9f9-5f80-5b85-b53c-7bfc7d08b658_expert_report_file_43da647c-d37a-49e5-b109-70de6bbe594a.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003737827-01964216-002.pdf',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '0dbba9f9-5f80-5b85-b53c-7bfc7d08b658',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'MF71ZXT',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/LAND%20ROVER/RANGE%20ROVER%20EVOQUE?id=3737827',
 'listing': 'auction',
 'location': 'Bristol',
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER EVOQUE',
 'odometer': 31348,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 27,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dbba9f9-5f80-5b85-b53c-7bfc7d08b658/0dbba9f9-5f80-5b85-b53c-7bfc7d08b658_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 125695,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5f19311e-963e-4d0f-ba66-5d0b7d6a764a_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dbba9f9-5f80-5b85-b53c-7bfc7d08b658/0dbba9f9-5f80-5b85-b53c-7bfc7d08b658_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 125695,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5f19311e-963e-4d0f-ba66-5d0b7d6a764a_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dbba9f9-5f80-5b85-b53c-7bfc7d08b658/0dbba9f9-5f80-5b85-b53c-7bfc7d08b658_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 248229,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5f19311e-963e-4d0f-ba66-5d0b7d6a764a_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dbba9f9-5f80-5b85-b53c-7bfc7d08b658/0dbba9f9-5f80-5b85-b53c-7bfc7d08b658_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 247578,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5f19311e-963e-4d0f-ba66-5d0b7d6a764a_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dbba9f9-5f80-5b85-b53c-7bfc7d08b658/0dbba9f9-5f80-5b85-b53c-7bfc7d08b658_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120153,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5f19311e-963e-4d0f-ba66-5d0b7d6a764a_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dbba9f9-5f80-5b85-b53c-7bfc7d08b658/0dbba9f9-5f80-5b85-b53c-7bfc7d08b658_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117988,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5f19311e-963e-4d0f-ba66-5d0b7d6a764a_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dbba9f9-5f80-5b85-b53c-7bfc7d08b658/0dbba9f9-5f80-5b85-b53c-7bfc7d08b658_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 126792,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5f19311e-963e-4d0f-ba66-5d0b7d6a764a_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dbba9f9-5f80-5b85-b53c-7bfc7d08b658/0dbba9f9-5f80-5b85-b53c-7bfc7d08b658_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 121711,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5f19311e-963e-4d0f-ba66-5d0b7d6a764a_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dbba9f9-5f80-5b85-b53c-7bfc7d08b658/0dbba9f9-5f80-5b85-b53c-7bfc7d08b658_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 124717,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5f19311e-963e-4d0f-ba66-5d0b7d6a764a_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dbba9f9-5f80-5b85-b53c-7bfc7d08b658/0dbba9f9-5f80-5b85-b53c-7bfc7d08b658_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 222516,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5f19311e-963e-4d0f-ba66-5d0b7d6a764a_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dbba9f9-5f80-5b85-b53c-7bfc7d08b658/0dbba9f9-5f80-5b85-b53c-7bfc7d08b658_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 225946,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5f19311e-963e-4d0f-ba66-5d0b7d6a764a_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dbba9f9-5f80-5b85-b53c-7bfc7d08b658/0dbba9f9-5f80-5b85-b53c-7bfc7d08b658_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 241550,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5f19311e-963e-4d0f-ba66-5d0b7d6a764a_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dbba9f9-5f80-5b85-b53c-7bfc7d08b658/0dbba9f9-5f80-5b85-b53c-7bfc7d08b658_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 276694,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5f19311e-963e-4d0f-ba66-5d0b7d6a764a_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dbba9f9-5f80-5b85-b53c-7bfc7d08b658/0dbba9f9-5f80-5b85-b53c-7bfc7d08b658_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 398270,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3737827-3994076-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dbba9f9-5f80-5b85-b53c-7bfc7d08b658/0dbba9f9-5f80-5b85-b53c-7bfc7d08b658_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 238968,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3737827-3994076-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dbba9f9-5f80-5b85-b53c-7bfc7d08b658/0dbba9f9-5f80-5b85-b53c-7bfc7d08b658_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 291899,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3737827-3994076-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dbba9f9-5f80-5b85-b53c-7bfc7d08b658/0dbba9f9-5f80-5b85-b53c-7bfc7d08b658_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 283373,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3737827-3994076-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dbba9f9-5f80-5b85-b53c-7bfc7d08b658/0dbba9f9-5f80-5b85-b53c-7bfc7d08b658_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 390841,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3737827-3994076-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dbba9f9-5f80-5b85-b53c-7bfc7d08b658/0dbba9f9-5f80-5b85-b53c-7bfc7d08b658_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 302014,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3737827-3994076-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dbba9f9-5f80-5b85-b53c-7bfc7d08b658/0dbba9f9-5f80-5b85-b53c-7bfc7d08b658_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 494326,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3737827-3994076-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-08',
 'seller_name': 'Novuna Vehicle Solutions',
 'title': 'LAND ROVER RANGE ROVER EVOQUE 2.0 D165 R-Dynamic 5dr 2WD',
 'transmission': 'manual',
 'trim': '2.0 D165 R-Dynamic 5dr 2WD',
 'year': 2021}
2025-12-04 10:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273737827%27 HTTP/1.1" 200 None
2025-12-04 10:05:53 [manheim.gb] INFO: Saving data for 3737827: {'created_time': 1764842753.835061, 'last_price_update_time': 1764842753.835074, 'auction_closing_time': 1765270800.0}
2025-12-04 10:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3737827') HTTP/1.1" 204 0
2025-12-04 10:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5d248c1a-99e8-479d-9907-c883d119f466_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737761-01967847-003.pdf)
2025-12-04 10:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7787796d-09e9-45c7-9633-610d7ed6024b_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737837-01987105-002.pdf)
2025-12-04 10:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7787796d-09e9-45c7-9633-610d7ed6024b_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737837-01987105-002.pdf)
2025-12-04 10:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5d248c1a-99e8-479d-9907-c883d119f466_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737761-01967847-003.pdf)
2025-12-04 10:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7787796d-09e9-45c7-9633-610d7ed6024b_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003737837-01987105-002.pdf)
2025-12-04 10:05:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6e6ed0>
2025-12-04 10:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 10:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbf6a261-72e5-58f4-adf3-e63bfe23c322/cbf6a261-72e5-58f4-adf3-e63bfe23c322_image_8.jpg HTTP/1.1" 201 0
2025-12-04 10:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7787796d-09e9-45c7-9633-610d7ed6024b_9.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7787796d-09e9-45c7-9633-610d7ed6024b_9.jpg saved to cache
2025-12-04 10:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cbf6a261-72e5-58f4-adf3-e63bfe23c322
2025-12-04 10:05:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf094d0>
2025-12-04 10:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_417a6ff8-aba3-55b0-b54f-462a6dc74cf6/417a6ff8-aba3-55b0-b54f-462a6dc74cf6_image_3.jpg HTTP/1.1" 201 0
2025-12-04 10:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5d248c1a-99e8-479d-9907-c883d119f466_ext_1.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5d248c1a-99e8-479d-9907-c883d119f466_ext_1.jpg saved to cache
2025-12-04 10:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 417a6ff8-aba3-55b0-b54f-462a6dc74cf6
2025-12-04 10:05:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc71bad0>
2025-12-04 10:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_417a6ff8-aba3-55b0-b54f-462a6dc74cf6/417a6ff8-aba3-55b0-b54f-462a6dc74cf6_image_2.jpg HTTP/1.1" 201 0
2025-12-04 10:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5d248c1a-99e8-479d-9907-c883d119f466_ext_6.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5d248c1a-99e8-479d-9907-c883d119f466_ext_6.jpg saved to cache
2025-12-04 10:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 417a6ff8-aba3-55b0-b54f-462a6dc74cf6
2025-12-04 10:05:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc64b310>
2025-12-04 10:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbf6a261-72e5-58f4-adf3-e63bfe23c322/cbf6a261-72e5-58f4-adf3-e63bfe23c322_image_9.jpg HTTP/1.1" 201 0
2025-12-04 10:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7787796d-09e9-45c7-9633-610d7ed6024b_ext_2.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7787796d-09e9-45c7-9633-610d7ed6024b_ext_2.jpg saved to cache
2025-12-04 10:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cbf6a261-72e5-58f4-adf3-e63bfe23c322
2025-12-04 10:05:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccca5f90>
2025-12-04 10:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbf6a261-72e5-58f4-adf3-e63bfe23c322/cbf6a261-72e5-58f4-adf3-e63bfe23c322_image_6.jpg HTTP/1.1" 201 0
2025-12-04 10:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7787796d-09e9-45c7-9633-610d7ed6024b_11.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7787796d-09e9-45c7-9633-610d7ed6024b_11.jpg saved to cache
2025-12-04 10:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cbf6a261-72e5-58f4-adf3-e63bfe23c322
2025-12-04 10:05:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5c27d0>
2025-12-04 10:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbf6a261-72e5-58f4-adf3-e63bfe23c322/cbf6a261-72e5-58f4-adf3-e63bfe23c322_image_7.jpg HTTP/1.1" 201 0
2025-12-04 10:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7787796d-09e9-45c7-9633-610d7ed6024b_10.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7787796d-09e9-45c7-9633-610d7ed6024b_10.jpg saved to cache
2025-12-04 10:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cbf6a261-72e5-58f4-adf3-e63bfe23c322
2025-12-04 10:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3737655-3988786-1002.jpg> (referer: None)
2025-12-04 10:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3737655-3988786-1005.jpg> (referer: None)
2025-12-04 10:05:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 10:05:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 10:05:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccec6c10>
2025-12-04 10:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_417a6ff8-aba3-55b0-b54f-462a6dc74cf6/417a6ff8-aba3-55b0-b54f-462a6dc74cf6_image_1.jpg HTTP/1.1" 201 0
2025-12-04 10:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5d248c1a-99e8-479d-9907-c883d119f466_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5d248c1a-99e8-479d-9907-c883d119f466_ext_7.jpg saved to cache
2025-12-04 10:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 417a6ff8-aba3-55b0-b54f-462a6dc74cf6
2025-12-04 10:05:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc68dc50>
2025-12-04 10:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbf6a261-72e5-58f4-adf3-e63bfe23c322/cbf6a261-72e5-58f4-adf3-e63bfe23c322_image_5.jpg HTTP/1.1" 201 0
2025-12-04 10:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7787796d-09e9-45c7-9633-610d7ed6024b_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7787796d-09e9-45c7-9633-610d7ed6024b_4.jpg saved to cache
2025-12-04 10:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cbf6a261-72e5-58f4-adf3-e63bfe23c322
2025-12-04 10:05:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc54e750>
2025-12-04 10:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbf6a261-72e5-58f4-adf3-e63bfe23c322/cbf6a261-72e5-58f4-adf3-e63bfe23c322_image_4.jpg HTTP/1.1" 201 0
2025-12-04 10:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7787796d-09e9-45c7-9633-610d7ed6024b_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7787796d-09e9-45c7-9633-610d7ed6024b_5.jpg saved to cache
2025-12-04 10:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cbf6a261-72e5-58f4-adf3-e63bfe23c322
2025-12-04 10:05:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccc9fc90>
2025-12-04 10:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_417a6ff8-aba3-55b0-b54f-462a6dc74cf6/417a6ff8-aba3-55b0-b54f-462a6dc74cf6_image_0.jpg HTTP/1.1" 201 0
2025-12-04 10:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5d248c1a-99e8-479d-9907-c883d119f466_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5d248c1a-99e8-479d-9907-c883d119f466_ext_7.jpg saved to cache
2025-12-04 10:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 417a6ff8-aba3-55b0-b54f-462a6dc74cf6
2025-12-04 10:05:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 417a6ff8-aba3-55b0-b54f-462a6dc74cf6, skipping ID generation
2025-12-04 10:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 417a6ff8-aba3-55b0-b54f-462a6dc74cf6 from tracking dictionaries
2025-12-04 10:05:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 417a6ff8-aba3-55b0-b54f-462a6dc74cf6 sending to next pipeline
2025-12-04 10:05:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 417a6ff8-aba3-55b0-b54f-462a6dc74cf6, identifier: 3737761
2025-12-04 10:05:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd0db1d0>
2025-12-04 10:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbf6a261-72e5-58f4-adf3-e63bfe23c322/cbf6a261-72e5-58f4-adf3-e63bfe23c322_image_1.jpg HTTP/1.1" 201 0
2025-12-04 10:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7787796d-09e9-45c7-9633-610d7ed6024b_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7787796d-09e9-45c7-9633-610d7ed6024b_ext_7.jpg saved to cache
2025-12-04 10:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cbf6a261-72e5-58f4-adf3-e63bfe23c322
2025-12-04 10:05:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cbf6a261-72e5-58f4-adf3-e63bfe23c322, skipping ID generation
2025-12-04 10:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Removing item cbf6a261-72e5-58f4-adf3-e63bfe23c322 from tracking dictionaries
2025-12-04 10:05:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cbf6a261-72e5-58f4-adf3-e63bfe23c322 sending to next pipeline
2025-12-04 10:05:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: cbf6a261-72e5-58f4-adf3-e63bfe23c322, identifier: 3737837
2025-12-04 10:05:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 417a6ff8-aba3-55b0-b54f-462a6dc74cf6 with identifier: 3737761
2025-12-04 10:05:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 417a6ff8-aba3-55b0-b54f-462a6dc74cf6 with identifier: 3737761
2025-12-04 10:05:57 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 417a6ff8-aba3-55b0-b54f-462a6dc74cf6 with identifier: 3737761 to the API
2025-12-04 10:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 10:05:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 10:05:57 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/5d248c1a-99e8-479d-9907-c883d119f466_ext_7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_417a6ff8-aba3-55b0-b54f-462a6dc74cf6/417a6ff8-aba3-55b0-b54f-462a6dc74cf6_expert_report_file_b32ffafd-2c14-4bbe-8d80-3e284ea9bee5.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003737761-01967847-003.pdf',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '1.5L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '417a6ff8-aba3-55b0-b54f-462a6dc74cf6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'FY22HGE',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/CITROEN/C3?id=3737761',
 'listing': 'auction',
 'location': 'Leeds',
 'make': 'CITROEN',
 'model': 'C3',
 'odometer': 65984,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_417a6ff8-aba3-55b0-b54f-462a6dc74cf6/417a6ff8-aba3-55b0-b54f-462a6dc74cf6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 201731,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5d248c1a-99e8-479d-9907-c883d119f466_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_417a6ff8-aba3-55b0-b54f-462a6dc74cf6/417a6ff8-aba3-55b0-b54f-462a6dc74cf6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 201731,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5d248c1a-99e8-479d-9907-c883d119f466_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_417a6ff8-aba3-55b0-b54f-462a6dc74cf6/417a6ff8-aba3-55b0-b54f-462a6dc74cf6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 234453,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5d248c1a-99e8-479d-9907-c883d119f466_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_417a6ff8-aba3-55b0-b54f-462a6dc74cf6/417a6ff8-aba3-55b0-b54f-462a6dc74cf6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 193615,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5d248c1a-99e8-479d-9907-c883d119f466_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_417a6ff8-aba3-55b0-b54f-462a6dc74cf6/417a6ff8-aba3-55b0-b54f-462a6dc74cf6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 194901,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5d248c1a-99e8-479d-9907-c883d119f466_5.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_417a6ff8-aba3-55b0-b54f-462a6dc74cf6/417a6ff8-aba3-55b0-b54f-462a6dc74cf6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 201881,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5d248c1a-99e8-479d-9907-c883d119f466_4.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_417a6ff8-aba3-55b0-b54f-462a6dc74cf6/417a6ff8-aba3-55b0-b54f-462a6dc74cf6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 188619,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5d248c1a-99e8-479d-9907-c883d119f466_11.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_417a6ff8-aba3-55b0-b54f-462a6dc74cf6/417a6ff8-aba3-55b0-b54f-462a6dc74cf6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 199757,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5d248c1a-99e8-479d-9907-c883d119f466_10.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_417a6ff8-aba3-55b0-b54f-462a6dc74cf6/417a6ff8-aba3-55b0-b54f-462a6dc74cf6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 209696,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5d248c1a-99e8-479d-9907-c883d119f466_9.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_417a6ff8-aba3-55b0-b54f-462a6dc74cf6/417a6ff8-aba3-55b0-b54f-462a6dc74cf6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 252552,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5d248c1a-99e8-479d-9907-c883d119f466_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_417a6ff8-aba3-55b0-b54f-462a6dc74cf6/417a6ff8-aba3-55b0-b54f-462a6dc74cf6_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 196113,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5d248c1a-99e8-479d-9907-c883d119f466_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_417a6ff8-aba3-55b0-b54f-462a6dc74cf6/417a6ff8-aba3-55b0-b54f-462a6dc74cf6_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 198503,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5d248c1a-99e8-479d-9907-c883d119f466_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_417a6ff8-aba3-55b0-b54f-462a6dc74cf6/417a6ff8-aba3-55b0-b54f-462a6dc74cf6_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 247670,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5d248c1a-99e8-479d-9907-c883d119f466_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_417a6ff8-aba3-55b0-b54f-462a6dc74cf6/417a6ff8-aba3-55b0-b54f-462a6dc74cf6_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 389420,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3737761-3983477-13.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_417a6ff8-aba3-55b0-b54f-462a6dc74cf6/417a6ff8-aba3-55b0-b54f-462a6dc74cf6_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 320687,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3737761-3983477-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_417a6ff8-aba3-55b0-b54f-462a6dc74cf6/417a6ff8-aba3-55b0-b54f-462a6dc74cf6_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 206302,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3737761-3983477-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_417a6ff8-aba3-55b0-b54f-462a6dc74cf6/417a6ff8-aba3-55b0-b54f-462a6dc74cf6_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 266754,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3737761-3983477-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_417a6ff8-aba3-55b0-b54f-462a6dc74cf6/417a6ff8-aba3-55b0-b54f-462a6dc74cf6_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 343406,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3737761-3983477-1003.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_417a6ff8-aba3-55b0-b54f-462a6dc74cf6/417a6ff8-aba3-55b0-b54f-462a6dc74cf6_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 329835,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3737761-3983477-1004.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_417a6ff8-aba3-55b0-b54f-462a6dc74cf6/417a6ff8-aba3-55b0-b54f-462a6dc74cf6_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 277353,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3737761-3983477-1005.jpg',
             'Width': 1500}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-07',
 'seller_name': 'Novuna Vehicle Solutions',
 'title': 'CITROEN C3 1.5 BlueHDi Shine Plus 5dr',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi Shine Plus 5dr',
 'year': 2022}
2025-12-04 10:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273737761%27 HTTP/1.1" 200 None
2025-12-04 10:05:57 [manheim.gb] INFO: Saving data for 3737761: {'created_time': 1764842757.349557, 'last_price_update_time': 1764842757.349568, 'auction_closing_time': 1765184400.0}
2025-12-04 10:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3737761') HTTP/1.1" 204 0
2025-12-04 10:05:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: cbf6a261-72e5-58f4-adf3-e63bfe23c322 with identifier: 3737837
2025-12-04 10:05:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: cbf6a261-72e5-58f4-adf3-e63bfe23c322 with identifier: 3737837
2025-12-04 10:05:57 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: cbf6a261-72e5-58f4-adf3-e63bfe23c322 with identifier: 3737837 to the API
2025-12-04 10:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 10:05:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 10:05:57 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/7787796d-09e9-45c7-9633-610d7ed6024b_ext_7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbf6a261-72e5-58f4-adf3-e63bfe23c322/cbf6a261-72e5-58f4-adf3-e63bfe23c322_expert_report_file_53191d07-fce4-4504-a5bb-7fbdbe2649bd.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003737837-01987105-002.pdf',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '0.0L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Electric',
 'id': 'cbf6a261-72e5-58f4-adf3-e63bfe23c322',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'YK21XJU',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/TESLA/MODEL?id=3737837',
 'listing': 'directbuy',
 'location': 'Leeds',
 'make': 'TESLA',
 'model': 'MODEL',
 'odometer': 24476,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 28,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbf6a261-72e5-58f4-adf3-e63bfe23c322/cbf6a261-72e5-58f4-adf3-e63bfe23c322_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 184210,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7787796d-09e9-45c7-9633-610d7ed6024b_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbf6a261-72e5-58f4-adf3-e63bfe23c322/cbf6a261-72e5-58f4-adf3-e63bfe23c322_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 184210,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7787796d-09e9-45c7-9633-610d7ed6024b_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbf6a261-72e5-58f4-adf3-e63bfe23c322/cbf6a261-72e5-58f4-adf3-e63bfe23c322_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 211848,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7787796d-09e9-45c7-9633-610d7ed6024b_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbf6a261-72e5-58f4-adf3-e63bfe23c322/cbf6a261-72e5-58f4-adf3-e63bfe23c322_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 229079,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7787796d-09e9-45c7-9633-610d7ed6024b_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbf6a261-72e5-58f4-adf3-e63bfe23c322/cbf6a261-72e5-58f4-adf3-e63bfe23c322_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 141050,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7787796d-09e9-45c7-9633-610d7ed6024b_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbf6a261-72e5-58f4-adf3-e63bfe23c322/cbf6a261-72e5-58f4-adf3-e63bfe23c322_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 177443,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7787796d-09e9-45c7-9633-610d7ed6024b_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbf6a261-72e5-58f4-adf3-e63bfe23c322/cbf6a261-72e5-58f4-adf3-e63bfe23c322_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 156810,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7787796d-09e9-45c7-9633-610d7ed6024b_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbf6a261-72e5-58f4-adf3-e63bfe23c322/cbf6a261-72e5-58f4-adf3-e63bfe23c322_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 175330,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7787796d-09e9-45c7-9633-610d7ed6024b_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbf6a261-72e5-58f4-adf3-e63bfe23c322/cbf6a261-72e5-58f4-adf3-e63bfe23c322_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 193634,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7787796d-09e9-45c7-9633-610d7ed6024b_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbf6a261-72e5-58f4-adf3-e63bfe23c322/cbf6a261-72e5-58f4-adf3-e63bfe23c322_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 226163,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7787796d-09e9-45c7-9633-610d7ed6024b_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbf6a261-72e5-58f4-adf3-e63bfe23c322/cbf6a261-72e5-58f4-adf3-e63bfe23c322_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 174737,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7787796d-09e9-45c7-9633-610d7ed6024b_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbf6a261-72e5-58f4-adf3-e63bfe23c322/cbf6a261-72e5-58f4-adf3-e63bfe23c322_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 189581,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7787796d-09e9-45c7-9633-610d7ed6024b_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbf6a261-72e5-58f4-adf3-e63bfe23c322/cbf6a261-72e5-58f4-adf3-e63bfe23c322_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 208185,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7787796d-09e9-45c7-9633-610d7ed6024b_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbf6a261-72e5-58f4-adf3-e63bfe23c322/cbf6a261-72e5-58f4-adf3-e63bfe23c322_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46671,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3737837-4005180-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbf6a261-72e5-58f4-adf3-e63bfe23c322/cbf6a261-72e5-58f4-adf3-e63bfe23c322_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 225331,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3737837-4005180-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbf6a261-72e5-58f4-adf3-e63bfe23c322/cbf6a261-72e5-58f4-adf3-e63bfe23c322_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 151212,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3737837-4005180-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbf6a261-72e5-58f4-adf3-e63bfe23c322/cbf6a261-72e5-58f4-adf3-e63bfe23c322_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 26312,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3737837-4005180-1002.jpg',
             'Width': 1000},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbf6a261-72e5-58f4-adf3-e63bfe23c322/cbf6a261-72e5-58f4-adf3-e63bfe23c322_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 26312,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3737837-4005180-1003.jpg',
             'Width': 1000},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbf6a261-72e5-58f4-adf3-e63bfe23c322/cbf6a261-72e5-58f4-adf3-e63bfe23c322_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 26312,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3737837-4005180-1004.jpg',
             'Width': 1000},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbf6a261-72e5-58f4-adf3-e63bfe23c322/cbf6a261-72e5-58f4-adf3-e63bfe23c322_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 26312,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3737837-4005180-1005.jpg',
             'Width': 1000}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-09',
 'seller_name': 'Lloyd Motor Group',
 'title': 'TESLA MODEL Standard Plus 4dr Auto',
 'transmission': 'automatic',
 'trim': 'Standard Plus 4dr Auto',
 'year': 2021}
2025-12-04 10:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273737837%27 HTTP/1.1" 200 None
2025-12-04 10:05:57 [manheim.gb] INFO: Saving data for 3737837: {'created_time': 1764842757.745768, 'last_price_update_time': 1764842757.74578, 'auction_closing_time': 1765184400.0}
2025-12-04 10:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3737837') HTTP/1.1" 204 0
2025-12-04 10:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3737655-3988786-1003.jpg> (referer: None)
2025-12-04 10:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3737655-3988786-3.jpg> (referer: None)
2025-12-04 10:05:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 10:05:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 10:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3737655-3988786-15.jpg> (referer: None)
2025-12-04 10:05:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 10:05:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce51ad0>
2025-12-04 10:05:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_823fa041-4c2f-5fa5-b851-cbe9c59b2804/823fa041-4c2f-5fa5-b851-cbe9c59b2804_image_16.jpg HTTP/1.1" 201 0
2025-12-04 10:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737655-3988786-1002.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737655-3988786-1002.jpg saved to cache
2025-12-04 10:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 823fa041-4c2f-5fa5-b851-cbe9c59b2804
2025-12-04 10:05:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccfaf1d0>
2025-12-04 10:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_823fa041-4c2f-5fa5-b851-cbe9c59b2804/823fa041-4c2f-5fa5-b851-cbe9c59b2804_image_19.jpg HTTP/1.1" 201 0
2025-12-04 10:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737655-3988786-1005.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737655-3988786-1005.jpg saved to cache
2025-12-04 10:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 823fa041-4c2f-5fa5-b851-cbe9c59b2804
2025-12-04 10:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3737655-3988786-39.jpg> (referer: None)
2025-12-04 10:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/dbdb3c14-3fe2-450a-98a7-33597d0542ed_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003752426-01969136-004.pdf)
2025-12-04 10:05:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 10:05:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 10:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3740756-3983360-28.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003740756-01978016-001.pdf)
2025-12-04 10:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3740756-3983360-16.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003740756-01978016-001.pdf)
2025-12-04 10:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/dbdb3c14-3fe2-450a-98a7-33597d0542ed_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003752426-01969136-004.pdf)
2025-12-04 10:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/dbdb3c14-3fe2-450a-98a7-33597d0542ed_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003752426-01969136-004.pdf)
2025-12-04 10:05:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6fe5d0>
2025-12-04 10:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_823fa041-4c2f-5fa5-b851-cbe9c59b2804/823fa041-4c2f-5fa5-b851-cbe9c59b2804_image_17.jpg HTTP/1.1" 201 0
2025-12-04 10:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737655-3988786-1003.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737655-3988786-1003.jpg saved to cache
2025-12-04 10:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 823fa041-4c2f-5fa5-b851-cbe9c59b2804
2025-12-04 10:05:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce51650>
2025-12-04 10:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_823fa041-4c2f-5fa5-b851-cbe9c59b2804/823fa041-4c2f-5fa5-b851-cbe9c59b2804_image_2.jpg HTTP/1.1" 201 0
2025-12-04 10:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737655-3988786-3.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737655-3988786-3.jpg saved to cache
2025-12-04 10:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 823fa041-4c2f-5fa5-b851-cbe9c59b2804
2025-12-04 10:05:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce502d0>
2025-12-04 10:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_823fa041-4c2f-5fa5-b851-cbe9c59b2804/823fa041-4c2f-5fa5-b851-cbe9c59b2804_image_7.jpg HTTP/1.1" 201 0
2025-12-04 10:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737655-3988786-15.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737655-3988786-15.jpg saved to cache
2025-12-04 10:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 823fa041-4c2f-5fa5-b851-cbe9c59b2804
2025-12-04 10:05:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 10:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003739898-01981917-002.pdf> (referer: None)
2025-12-04 10:05:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc58cfd0>
2025-12-04 10:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 10:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_823fa041-4c2f-5fa5-b851-cbe9c59b2804/823fa041-4c2f-5fa5-b851-cbe9c59b2804_image_10.jpg HTTP/1.1" 201 0
2025-12-04 10:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3737655-3988786-39.jpg') HTTP/1.1" 204 0
2025-12-04 10:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3737655-3988786-39.jpg saved to cache
2025-12-04 10:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 823fa041-4c2f-5fa5-b851-cbe9c59b2804
2025-12-04 10:05:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 823fa041-4c2f-5fa5-b851-cbe9c59b2804, skipping ID generation
2025-12-04 10:05:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 823fa041-4c2f-5fa5-b851-cbe9c59b2804 with scrape type 1
2025-12-04 10:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 823fa041-4c2f-5fa5-b851-cbe9c59b2804 from tracking dictionaries
2025-12-04 10:05:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 823fa041-4c2f-5fa5-b851-cbe9c59b2804 sending to next pipeline
2025-12-04 10:05:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 823fa041-4c2f-5fa5-b851-cbe9c59b2804, identifier: 3737655
2025-12-04 10:05:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:05:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce51b10>
2025-12-04 10:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:05:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07a43b40-c094-5b22-b61d-8f11e55e71c0/07a43b40-c094-5b22-b61d-8f11e55e71c0_image_1.jpg HTTP/1.1" 201 0
2025-12-04 10:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdbdb3c14-3fe2-450a-98a7-33597d0542ed_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dbdb3c14-3fe2-450a-98a7-33597d0542ed_ext_7.jpg saved to cache
2025-12-04 10:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 07a43b40-c094-5b22-b61d-8f11e55e71c0
2025-12-04 10:06:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc613550>
2025-12-04 10:06:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27c40b73-4217-5525-8def-8f7189d22661/27c40b73-4217-5525-8def-8f7189d22661_image_16.jpg HTTP/1.1" 201 0
2025-12-04 10:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3740756-3983360-28.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3740756-3983360-28.jpg saved to cache
2025-12-04 10:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 27c40b73-4217-5525-8def-8f7189d22661
2025-12-04 10:06:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd0a1c90>
2025-12-04 10:06:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27c40b73-4217-5525-8def-8f7189d22661/27c40b73-4217-5525-8def-8f7189d22661_image_15.jpg HTTP/1.1" 201 0
2025-12-04 10:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3740756-3983360-16.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3740756-3983360-16.jpg saved to cache
2025-12-04 10:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 27c40b73-4217-5525-8def-8f7189d22661
2025-12-04 10:06:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 27c40b73-4217-5525-8def-8f7189d22661, skipping ID generation
2025-12-04 10:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 27c40b73-4217-5525-8def-8f7189d22661 from tracking dictionaries
2025-12-04 10:06:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 27c40b73-4217-5525-8def-8f7189d22661 sending to next pipeline
2025-12-04 10:06:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 27c40b73-4217-5525-8def-8f7189d22661, identifier: 3740756
2025-12-04 10:06:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc7dc790>
2025-12-04 10:06:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07a43b40-c094-5b22-b61d-8f11e55e71c0/07a43b40-c094-5b22-b61d-8f11e55e71c0_image_2.jpg HTTP/1.1" 201 0
2025-12-04 10:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdbdb3c14-3fe2-450a-98a7-33597d0542ed_ext_6.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dbdb3c14-3fe2-450a-98a7-33597d0542ed_ext_6.jpg saved to cache
2025-12-04 10:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 07a43b40-c094-5b22-b61d-8f11e55e71c0
2025-12-04 10:06:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccfe0790>
2025-12-04 10:06:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07a43b40-c094-5b22-b61d-8f11e55e71c0/07a43b40-c094-5b22-b61d-8f11e55e71c0_image_0.jpg HTTP/1.1" 201 0
2025-12-04 10:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdbdb3c14-3fe2-450a-98a7-33597d0542ed_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dbdb3c14-3fe2-450a-98a7-33597d0542ed_ext_7.jpg saved to cache
2025-12-04 10:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 07a43b40-c094-5b22-b61d-8f11e55e71c0
2025-12-04 10:06:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 07a43b40-c094-5b22-b61d-8f11e55e71c0, skipping ID generation
2025-12-04 10:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 07a43b40-c094-5b22-b61d-8f11e55e71c0 from tracking dictionaries
2025-12-04 10:06:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 07a43b40-c094-5b22-b61d-8f11e55e71c0 sending to next pipeline
2025-12-04 10:06:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 07a43b40-c094-5b22-b61d-8f11e55e71c0, identifier: 3752426
2025-12-04 10:06:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 823fa041-4c2f-5fa5-b851-cbe9c59b2804 with identifier: 3737655
2025-12-04 10:06:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 823fa041-4c2f-5fa5-b851-cbe9c59b2804 with identifier: 3737655
2025-12-04 10:06:01 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 823fa041-4c2f-5fa5-b851-cbe9c59b2804 with identifier: 3737655 to the API
2025-12-04 10:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 10:06:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 10:06:01 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/insp-0001-3737655-3988786-39.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 41,
 'car_expert_report_source_url': None,
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '1.5L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Petrol/Hybrid',
 'id': '823fa041-4c2f-5fa5-b851-cbe9c59b2804',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'LB21FDN',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MINI/COUNTRYMAN?id=3737655',
 'listing': 'auction',
 'location': 'Bristol',
 'make': 'MINI',
 'model': 'COUNTRYMAN',
 'odometer': 19049,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 26,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_823fa041-4c2f-5fa5-b851-cbe9c59b2804/823fa041-4c2f-5fa5-b851-cbe9c59b2804_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 532362,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3737655-3988786-1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_823fa041-4c2f-5fa5-b851-cbe9c59b2804/823fa041-4c2f-5fa5-b851-cbe9c59b2804_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 279421,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3737655-3988786-2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_823fa041-4c2f-5fa5-b851-cbe9c59b2804/823fa041-4c2f-5fa5-b851-cbe9c59b2804_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 223294,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3737655-3988786-3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_823fa041-4c2f-5fa5-b851-cbe9c59b2804/823fa041-4c2f-5fa5-b851-cbe9c59b2804_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 524868,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3737655-3988786-4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_823fa041-4c2f-5fa5-b851-cbe9c59b2804/823fa041-4c2f-5fa5-b851-cbe9c59b2804_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 441374,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3737655-3988786-6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_823fa041-4c2f-5fa5-b851-cbe9c59b2804/823fa041-4c2f-5fa5-b851-cbe9c59b2804_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 380030,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3737655-3988786-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_823fa041-4c2f-5fa5-b851-cbe9c59b2804/823fa041-4c2f-5fa5-b851-cbe9c59b2804_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 412988,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3737655-3988786-8.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_823fa041-4c2f-5fa5-b851-cbe9c59b2804/823fa041-4c2f-5fa5-b851-cbe9c59b2804_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 326292,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3737655-3988786-15.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_823fa041-4c2f-5fa5-b851-cbe9c59b2804/823fa041-4c2f-5fa5-b851-cbe9c59b2804_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 257977,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3737655-3988786-16.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_823fa041-4c2f-5fa5-b851-cbe9c59b2804/823fa041-4c2f-5fa5-b851-cbe9c59b2804_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 314267,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3737655-3988786-28.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_823fa041-4c2f-5fa5-b851-cbe9c59b2804/823fa041-4c2f-5fa5-b851-cbe9c59b2804_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 347939,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3737655-3988786-39.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_823fa041-4c2f-5fa5-b851-cbe9c59b2804/823fa041-4c2f-5fa5-b851-cbe9c59b2804_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 293869,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3737655-3988786-42.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_823fa041-4c2f-5fa5-b851-cbe9c59b2804/823fa041-4c2f-5fa5-b851-cbe9c59b2804_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 252612,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3737655-3988786-43.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_823fa041-4c2f-5fa5-b851-cbe9c59b2804/823fa041-4c2f-5fa5-b851-cbe9c59b2804_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 235920,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3737655-3988786-44.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_823fa041-4c2f-5fa5-b851-cbe9c59b2804/823fa041-4c2f-5fa5-b851-cbe9c59b2804_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 300717,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3737655-3988786-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_823fa041-4c2f-5fa5-b851-cbe9c59b2804/823fa041-4c2f-5fa5-b851-cbe9c59b2804_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 276617,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3737655-3988786-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_823fa041-4c2f-5fa5-b851-cbe9c59b2804/823fa041-4c2f-5fa5-b851-cbe9c59b2804_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 298379,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3737655-3988786-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_823fa041-4c2f-5fa5-b851-cbe9c59b2804/823fa041-4c2f-5fa5-b851-cbe9c59b2804_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 488529,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3737655-3988786-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_823fa041-4c2f-5fa5-b851-cbe9c59b2804/823fa041-4c2f-5fa5-b851-cbe9c59b2804_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 285249,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3737655-3988786-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_823fa041-4c2f-5fa5-b851-cbe9c59b2804/823fa041-4c2f-5fa5-b851-cbe9c59b2804_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 338686,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3737655-3988786-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-02',
 'seller_name': 'Novuna Vehicle Solutions',
 'title': 'MINI COUNTRYMAN 1.5 Cooper S E Exclusive ALL4 PHEV 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.5 Cooper S E Exclusive ALL4 PHEV 5dr Auto',
 'year': 2021}
2025-12-04 10:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273737655%27 HTTP/1.1" 200 None
2025-12-04 10:06:01 [manheim.gb] INFO: Saving data for 3737655: {'created_time': 1764842761.787465, 'last_price_update_time': 1764842761.78748, 'auction_closing_time': 1765270800.0}
2025-12-04 10:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3737655') HTTP/1.1" 204 0
2025-12-04 10:06:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 27c40b73-4217-5525-8def-8f7189d22661 with identifier: 3740756
2025-12-04 10:06:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 27c40b73-4217-5525-8def-8f7189d22661 with identifier: 3740756
2025-12-04 10:06:01 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'mercedes-benz' containing 'mercedes' and model 'eqv' containing 'eqv'
2025-12-04 10:06:01 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 27c40b73-4217-5525-8def-8f7189d22661 spider: manheim.gb
2025-12-04 10:06:02 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 27c40b73-4217-5525-8def-8f7189d22661 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'mercedes-benz' containing 'mercedes' and model 'eqv' containing 'eqv'
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27c40b73-4217-5525-8def-8f7189d22661/27c40b73-4217-5525-8def-8f7189d22661_expert_report_file_90fc2d2e-2130-4e65-a7f0-6f574274eef8.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003740756-01978016-001.pdf',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '0.0L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Electric',
 'id': '27c40b73-4217-5525-8def-8f7189d22661',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'WF22NKR',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/EQV?id=3740756',
 'listing': 'auction',
 'location': 'Leeds - In Transit',
 'make': 'MERCEDES-BENZ',
 'model': 'EQV',
 'odometer': 34703,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 30,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27c40b73-4217-5525-8def-8f7189d22661/27c40b73-4217-5525-8def-8f7189d22661_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 199248,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/344b9b73-5087-49b0-835a-3de2e774a198_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27c40b73-4217-5525-8def-8f7189d22661/27c40b73-4217-5525-8def-8f7189d22661_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 199248,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/344b9b73-5087-49b0-835a-3de2e774a198_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27c40b73-4217-5525-8def-8f7189d22661/27c40b73-4217-5525-8def-8f7189d22661_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 263000,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/344b9b73-5087-49b0-835a-3de2e774a198_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27c40b73-4217-5525-8def-8f7189d22661/27c40b73-4217-5525-8def-8f7189d22661_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 208675,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/344b9b73-5087-49b0-835a-3de2e774a198_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27c40b73-4217-5525-8def-8f7189d22661/27c40b73-4217-5525-8def-8f7189d22661_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 195877,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/344b9b73-5087-49b0-835a-3de2e774a198_5.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27c40b73-4217-5525-8def-8f7189d22661/27c40b73-4217-5525-8def-8f7189d22661_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 203762,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/344b9b73-5087-49b0-835a-3de2e774a198_4.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27c40b73-4217-5525-8def-8f7189d22661/27c40b73-4217-5525-8def-8f7189d22661_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 189541,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/344b9b73-5087-49b0-835a-3de2e774a198_11.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27c40b73-4217-5525-8def-8f7189d22661/27c40b73-4217-5525-8def-8f7189d22661_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 201910,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/344b9b73-5087-49b0-835a-3de2e774a198_10.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27c40b73-4217-5525-8def-8f7189d22661/27c40b73-4217-5525-8def-8f7189d22661_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 225095,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/344b9b73-5087-49b0-835a-3de2e774a198_9.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27c40b73-4217-5525-8def-8f7189d22661/27c40b73-4217-5525-8def-8f7189d22661_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 273594,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/344b9b73-5087-49b0-835a-3de2e774a198_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27c40b73-4217-5525-8def-8f7189d22661/27c40b73-4217-5525-8def-8f7189d22661_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 270379,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/344b9b73-5087-49b0-835a-3de2e774a198_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27c40b73-4217-5525-8def-8f7189d22661/27c40b73-4217-5525-8def-8f7189d22661_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 268684,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/344b9b73-5087-49b0-835a-3de2e774a198_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27c40b73-4217-5525-8def-8f7189d22661/27c40b73-4217-5525-8def-8f7189d22661_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 246009,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/344b9b73-5087-49b0-835a-3de2e774a198_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27c40b73-4217-5525-8def-8f7189d22661/27c40b73-4217-5525-8def-8f7189d22661_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 340577,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3740756-4002138-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27c40b73-4217-5525-8def-8f7189d22661/27c40b73-4217-5525-8def-8f7189d22661_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 280840,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3740756-3983360-15.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27c40b73-4217-5525-8def-8f7189d22661/27c40b73-4217-5525-8def-8f7189d22661_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 327340,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3740756-3983360-16.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27c40b73-4217-5525-8def-8f7189d22661/27c40b73-4217-5525-8def-8f7189d22661_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 368348,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3740756-3983360-28.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27c40b73-4217-5525-8def-8f7189d22661/27c40b73-4217-5525-8def-8f7189d22661_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 415125,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3740756-3983360-39.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27c40b73-4217-5525-8def-8f7189d22661/27c40b73-4217-5525-8def-8f7189d22661_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 255151,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3740756-3983360-43.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27c40b73-4217-5525-8def-8f7189d22661/27c40b73-4217-5525-8def-8f7189d22661_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 231867,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3740756-3983360-44.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-29',
 'seller_name': 'Novuna Vehicle Solutions',
 'title': 'MERCEDES-BENZ EQV EQB 300 4M 168kW AMG Line Premium 66.5kWh 5dr '
          'Auto',
 'transmission': 'automatic',
 'trim': 'EQB 300 4M 168kW AMG Line Premium 66.5kWh 5dr Auto',
 'year': 2022}
2025-12-04 10:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273740756%27 HTTP/1.1" 200 None
2025-12-04 10:06:02 [manheim.gb] INFO: Saving data for 3740756: {'created_time': 1764842762.0332, 'last_price_update_time': 1764842762.033211, 'auction_closing_time': 1765184400.0}
2025-12-04 10:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3740756') HTTP/1.1" 204 0
2025-12-04 10:06:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 07a43b40-c094-5b22-b61d-8f11e55e71c0 with identifier: 3752426
2025-12-04 10:06:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 07a43b40-c094-5b22-b61d-8f11e55e71c0 with identifier: 3752426
2025-12-04 10:06:02 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 07a43b40-c094-5b22-b61d-8f11e55e71c0 with identifier: 3752426 to the API
2025-12-04 10:06:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 10:06:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 10:06:02 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/dbdb3c14-3fe2-450a-98a7-33597d0542ed_ext_7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 158,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07a43b40-c094-5b22-b61d-8f11e55e71c0/07a43b40-c094-5b22-b61d-8f11e55e71c0_expert_report_file_dce18227-575a-4c07-9c51-03b7552502b9.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003752426-01969136-004.pdf',
 'color': 'BLUE',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Petrol/Hybrid',
 'id': '07a43b40-c094-5b22-b61d-8f11e55e71c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'MM22CSF',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/KIA/SORENTO?id=3752426',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'KIA',
 'model': 'SORENTO',
 'odometer': 22850,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 41,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07a43b40-c094-5b22-b61d-8f11e55e71c0/07a43b40-c094-5b22-b61d-8f11e55e71c0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 193177,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dbdb3c14-3fe2-450a-98a7-33597d0542ed_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07a43b40-c094-5b22-b61d-8f11e55e71c0/07a43b40-c094-5b22-b61d-8f11e55e71c0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 193177,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dbdb3c14-3fe2-450a-98a7-33597d0542ed_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07a43b40-c094-5b22-b61d-8f11e55e71c0/07a43b40-c094-5b22-b61d-8f11e55e71c0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 350653,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dbdb3c14-3fe2-450a-98a7-33597d0542ed_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07a43b40-c094-5b22-b61d-8f11e55e71c0/07a43b40-c094-5b22-b61d-8f11e55e71c0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 184512,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dbdb3c14-3fe2-450a-98a7-33597d0542ed_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07a43b40-c094-5b22-b61d-8f11e55e71c0/07a43b40-c094-5b22-b61d-8f11e55e71c0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 200260,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dbdb3c14-3fe2-450a-98a7-33597d0542ed_5.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07a43b40-c094-5b22-b61d-8f11e55e71c0/07a43b40-c094-5b22-b61d-8f11e55e71c0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 195674,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dbdb3c14-3fe2-450a-98a7-33597d0542ed_4.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07a43b40-c094-5b22-b61d-8f11e55e71c0/07a43b40-c094-5b22-b61d-8f11e55e71c0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 205496,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dbdb3c14-3fe2-450a-98a7-33597d0542ed_11.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07a43b40-c094-5b22-b61d-8f11e55e71c0/07a43b40-c094-5b22-b61d-8f11e55e71c0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 194990,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dbdb3c14-3fe2-450a-98a7-33597d0542ed_10.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07a43b40-c094-5b22-b61d-8f11e55e71c0/07a43b40-c094-5b22-b61d-8f11e55e71c0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 206164,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dbdb3c14-3fe2-450a-98a7-33597d0542ed_9.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07a43b40-c094-5b22-b61d-8f11e55e71c0/07a43b40-c094-5b22-b61d-8f11e55e71c0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 315182,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dbdb3c14-3fe2-450a-98a7-33597d0542ed_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07a43b40-c094-5b22-b61d-8f11e55e71c0/07a43b40-c094-5b22-b61d-8f11e55e71c0_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 265025,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dbdb3c14-3fe2-450a-98a7-33597d0542ed_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07a43b40-c094-5b22-b61d-8f11e55e71c0/07a43b40-c094-5b22-b61d-8f11e55e71c0_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 251019,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dbdb3c14-3fe2-450a-98a7-33597d0542ed_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07a43b40-c094-5b22-b61d-8f11e55e71c0/07a43b40-c094-5b22-b61d-8f11e55e71c0_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 260421,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dbdb3c14-3fe2-450a-98a7-33597d0542ed_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07a43b40-c094-5b22-b61d-8f11e55e71c0/07a43b40-c094-5b22-b61d-8f11e55e71c0_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 269559,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3752426-3988881-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07a43b40-c094-5b22-b61d-8f11e55e71c0/07a43b40-c094-5b22-b61d-8f11e55e71c0_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 221044,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3752426-3988881-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07a43b40-c094-5b22-b61d-8f11e55e71c0/07a43b40-c094-5b22-b61d-8f11e55e71c0_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 293446,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3752426-3988881-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07a43b40-c094-5b22-b61d-8f11e55e71c0/07a43b40-c094-5b22-b61d-8f11e55e71c0_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 348788,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3752426-3988881-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07a43b40-c094-5b22-b61d-8f11e55e71c0/07a43b40-c094-5b22-b61d-8f11e55e71c0_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 251424,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3752426-3988881-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07a43b40-c094-5b22-b61d-8f11e55e71c0/07a43b40-c094-5b22-b61d-8f11e55e71c0_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 255961,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3752426-3988881-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07a43b40-c094-5b22-b61d-8f11e55e71c0/07a43b40-c094-5b22-b61d-8f11e55e71c0_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 286948,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3752426-3988881-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-04',
 'seller_name': 'Leasys',
 'title': 'KIA SORENTO 1.6 T-GDi HEV 2 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.6 T-GDi HEV 2 5dr Auto',
 'year': 2022}
2025-12-04 10:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273752426%27 HTTP/1.1" 200 None
2025-12-04 10:06:02 [manheim.gb] INFO: Saving data for 3752426: {'created_time': 1764842762.468737, 'last_price_update_time': 1764842762.468748, 'auction_closing_time': 1765270800.0}
2025-12-04 10:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3752426') HTTP/1.1" 204 0
2025-12-04 10:06:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd01dc90>
2025-12-04 10:06:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:06:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a78d527e-dc6e-518f-ad6e-20beb5b60643/a78d527e-dc6e-518f-ad6e-20beb5b60643_expert_report_file_250e76e9-ddd6-4012-b67c-57aad05d8b04.pdf HTTP/1.1" 201 0
2025-12-04 10:06:02 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item a78d527e-dc6e-518f-ad6e-20beb5b60643
2025-12-04 10:06:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a78d527e-dc6e-518f-ad6e-20beb5b60643, skipping ID generation
2025-12-04 10:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item a78d527e-dc6e-518f-ad6e-20beb5b60643
2025-12-04 10:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F59096750-d732-4a04-93b4-5b26681153f6_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/59096750-d732-4a04-93b4-5b26681153f6_ext_7.jpg not downloaded yet
2025-12-04 10:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F59096750-d732-4a04-93b4-5b26681153f6_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/59096750-d732-4a04-93b4-5b26681153f6_ext_7.jpg not downloaded yet
2025-12-04 10:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F59096750-d732-4a04-93b4-5b26681153f6_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/59096750-d732-4a04-93b4-5b26681153f6_ext_6.jpg not downloaded yet
2025-12-04 10:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F59096750-d732-4a04-93b4-5b26681153f6_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/59096750-d732-4a04-93b4-5b26681153f6_ext_1.jpg not downloaded yet
2025-12-04 10:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F59096750-d732-4a04-93b4-5b26681153f6_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/59096750-d732-4a04-93b4-5b26681153f6_5.jpg not downloaded yet
2025-12-04 10:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F59096750-d732-4a04-93b4-5b26681153f6_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/59096750-d732-4a04-93b4-5b26681153f6_4.jpg not downloaded yet
2025-12-04 10:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F59096750-d732-4a04-93b4-5b26681153f6_11.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/59096750-d732-4a04-93b4-5b26681153f6_11.jpg not downloaded yet
2025-12-04 10:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F59096750-d732-4a04-93b4-5b26681153f6_10.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/59096750-d732-4a04-93b4-5b26681153f6_10.jpg not downloaded yet
2025-12-04 10:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F59096750-d732-4a04-93b4-5b26681153f6_9.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/59096750-d732-4a04-93b4-5b26681153f6_9.jpg not downloaded yet
2025-12-04 10:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F59096750-d732-4a04-93b4-5b26681153f6_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/59096750-d732-4a04-93b4-5b26681153f6_ext_2.jpg not downloaded yet
2025-12-04 10:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F59096750-d732-4a04-93b4-5b26681153f6_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/59096750-d732-4a04-93b4-5b26681153f6_ext_5.jpg not downloaded yet
2025-12-04 10:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F59096750-d732-4a04-93b4-5b26681153f6_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/59096750-d732-4a04-93b4-5b26681153f6_ext_3.jpg not downloaded yet
2025-12-04 10:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F59096750-d732-4a04-93b4-5b26681153f6_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/59096750-d732-4a04-93b4-5b26681153f6_ext_4.jpg not downloaded yet
2025-12-04 10:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3739898-4000232-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3739898-4000232-13.jpg not downloaded yet
2025-12-04 10:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3739898-4000232-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3739898-4000232-1000.jpg not downloaded yet
2025-12-04 10:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3739898-4000232-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3739898-4000232-1001.jpg not downloaded yet
2025-12-04 10:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3739898-4000232-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3739898-4000232-1002.jpg not downloaded yet
2025-12-04 10:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3739898-4000232-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3739898-4000232-1003.jpg not downloaded yet
2025-12-04 10:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003732689-01709363-006.pdf> (referer: None)
2025-12-04 10:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3739898-4000232-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3739898-4000232-1004.jpg not downloaded yet
2025-12-04 10:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003733236-01988566-004.pdf> (referer: None)
2025-12-04 10:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3739898-4000232-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3739898-4000232-1005.jpg not downloaded yet
2025-12-04 10:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003753028-01726675-006.pdf> (referer: None)
2025-12-04 10:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003733108-01985605-002.pdf> (referer: None)
2025-12-04 10:06:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc671290>
2025-12-04 10:06:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d41ca17-91a5-5695-a2ce-4ac7d4eea455/9d41ca17-91a5-5695-a2ce-4ac7d4eea455_expert_report_file_2c93d5a1-cdb1-4e05-859c-0019e3fb07ef.pdf HTTP/1.1" 201 0
2025-12-04 10:06:03 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 9d41ca17-91a5-5695-a2ce-4ac7d4eea455
2025-12-04 10:06:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9d41ca17-91a5-5695-a2ce-4ac7d4eea455, skipping ID generation
2025-12-04 10:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 9d41ca17-91a5-5695-a2ce-4ac7d4eea455
2025-12-04 10:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F45c612c5-7ee9-412e-8fcd-cca7a96ef77a_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/45c612c5-7ee9-412e-8fcd-cca7a96ef77a_ext_7.jpg not downloaded yet
2025-12-04 10:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F45c612c5-7ee9-412e-8fcd-cca7a96ef77a_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/45c612c5-7ee9-412e-8fcd-cca7a96ef77a_ext_7.jpg not downloaded yet
2025-12-04 10:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F45c612c5-7ee9-412e-8fcd-cca7a96ef77a_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/45c612c5-7ee9-412e-8fcd-cca7a96ef77a_ext_6.jpg not downloaded yet
2025-12-04 10:06:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd75210>
2025-12-04 10:06:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd47cf9a-b495-54ed-94b9-5ff59695697b/cd47cf9a-b495-54ed-94b9-5ff59695697b_expert_report_file_58c627bb-910c-4d9b-9e95-4000738169e7.pdf HTTP/1.1" 201 0
2025-12-04 10:06:04 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item cd47cf9a-b495-54ed-94b9-5ff59695697b
2025-12-04 10:06:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cd47cf9a-b495-54ed-94b9-5ff59695697b, skipping ID generation
2025-12-04 10:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item cd47cf9a-b495-54ed-94b9-5ff59695697b
2025-12-04 10:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F221af4c0-de76-4df7-a700-c6c79e40e8c7_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/221af4c0-de76-4df7-a700-c6c79e40e8c7_ext_7.jpg not downloaded yet
2025-12-04 10:06:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce09610>
2025-12-04 10:06:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:06:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_672a8c4f-71d8-58f3-8299-077e7dbd1660/672a8c4f-71d8-58f3-8299-077e7dbd1660_expert_report_file_8ae9073a-809e-402a-b0ff-8d1a35a04607.pdf HTTP/1.1" 201 0
2025-12-04 10:06:04 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 672a8c4f-71d8-58f3-8299-077e7dbd1660
2025-12-04 10:06:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 672a8c4f-71d8-58f3-8299-077e7dbd1660, skipping ID generation
2025-12-04 10:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 672a8c4f-71d8-58f3-8299-077e7dbd1660
2025-12-04 10:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb0655140-7456-48b9-aa0e-6638426c5791_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b0655140-7456-48b9-aa0e-6638426c5791_ext_7.jpg not downloaded yet
2025-12-04 10:06:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd0f4490>
2025-12-04 10:06:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:06:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_280bb43a-4e12-593b-bbeb-807f0c52302f/280bb43a-4e12-593b-bbeb-807f0c52302f_expert_report_file_383d1505-dcc7-4ee3-be7a-a0f837b3823f.pdf HTTP/1.1" 201 0
2025-12-04 10:06:05 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 280bb43a-4e12-593b-bbeb-807f0c52302f
2025-12-04 10:06:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 280bb43a-4e12-593b-bbeb-807f0c52302f, skipping ID generation
2025-12-04 10:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 280bb43a-4e12-593b-bbeb-807f0c52302f
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc417bd0e-e9ad-4d21-9c97-d90052b22054_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c417bd0e-e9ad-4d21-9c97-d90052b22054_ext_7.jpg not downloaded yet
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F45c612c5-7ee9-412e-8fcd-cca7a96ef77a_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/45c612c5-7ee9-412e-8fcd-cca7a96ef77a_ext_1.jpg not downloaded yet
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F221af4c0-de76-4df7-a700-c6c79e40e8c7_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/221af4c0-de76-4df7-a700-c6c79e40e8c7_ext_7.jpg not downloaded yet
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb0655140-7456-48b9-aa0e-6638426c5791_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b0655140-7456-48b9-aa0e-6638426c5791_ext_7.jpg not downloaded yet
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc417bd0e-e9ad-4d21-9c97-d90052b22054_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c417bd0e-e9ad-4d21-9c97-d90052b22054_ext_7.jpg not downloaded yet
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F45c612c5-7ee9-412e-8fcd-cca7a96ef77a_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/45c612c5-7ee9-412e-8fcd-cca7a96ef77a_5.jpg not downloaded yet
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F221af4c0-de76-4df7-a700-c6c79e40e8c7_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/221af4c0-de76-4df7-a700-c6c79e40e8c7_ext_6.jpg not downloaded yet
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb0655140-7456-48b9-aa0e-6638426c5791_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b0655140-7456-48b9-aa0e-6638426c5791_ext_6.jpg not downloaded yet
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc417bd0e-e9ad-4d21-9c97-d90052b22054_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c417bd0e-e9ad-4d21-9c97-d90052b22054_ext_6.jpg not downloaded yet
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F45c612c5-7ee9-412e-8fcd-cca7a96ef77a_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/45c612c5-7ee9-412e-8fcd-cca7a96ef77a_4.jpg not downloaded yet
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F221af4c0-de76-4df7-a700-c6c79e40e8c7_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/221af4c0-de76-4df7-a700-c6c79e40e8c7_ext_1.jpg not downloaded yet
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb0655140-7456-48b9-aa0e-6638426c5791_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b0655140-7456-48b9-aa0e-6638426c5791_ext_1.jpg not downloaded yet
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc417bd0e-e9ad-4d21-9c97-d90052b22054_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c417bd0e-e9ad-4d21-9c97-d90052b22054_ext_1.jpg not downloaded yet
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F45c612c5-7ee9-412e-8fcd-cca7a96ef77a_11.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/45c612c5-7ee9-412e-8fcd-cca7a96ef77a_11.jpg not downloaded yet
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F221af4c0-de76-4df7-a700-c6c79e40e8c7_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/221af4c0-de76-4df7-a700-c6c79e40e8c7_5.jpg not downloaded yet
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb0655140-7456-48b9-aa0e-6638426c5791_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b0655140-7456-48b9-aa0e-6638426c5791_5.jpg not downloaded yet
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc417bd0e-e9ad-4d21-9c97-d90052b22054_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c417bd0e-e9ad-4d21-9c97-d90052b22054_5.jpg not downloaded yet
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F45c612c5-7ee9-412e-8fcd-cca7a96ef77a_10.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/45c612c5-7ee9-412e-8fcd-cca7a96ef77a_10.jpg not downloaded yet
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F221af4c0-de76-4df7-a700-c6c79e40e8c7_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/221af4c0-de76-4df7-a700-c6c79e40e8c7_4.jpg not downloaded yet
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb0655140-7456-48b9-aa0e-6638426c5791_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b0655140-7456-48b9-aa0e-6638426c5791_4.jpg not downloaded yet
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc417bd0e-e9ad-4d21-9c97-d90052b22054_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c417bd0e-e9ad-4d21-9c97-d90052b22054_4.jpg not downloaded yet
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F45c612c5-7ee9-412e-8fcd-cca7a96ef77a_9.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/45c612c5-7ee9-412e-8fcd-cca7a96ef77a_9.jpg not downloaded yet
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F221af4c0-de76-4df7-a700-c6c79e40e8c7_11.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/221af4c0-de76-4df7-a700-c6c79e40e8c7_11.jpg not downloaded yet
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb0655140-7456-48b9-aa0e-6638426c5791_11.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b0655140-7456-48b9-aa0e-6638426c5791_11.jpg not downloaded yet
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc417bd0e-e9ad-4d21-9c97-d90052b22054_11.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c417bd0e-e9ad-4d21-9c97-d90052b22054_11.jpg not downloaded yet
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F45c612c5-7ee9-412e-8fcd-cca7a96ef77a_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/45c612c5-7ee9-412e-8fcd-cca7a96ef77a_ext_2.jpg not downloaded yet
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F221af4c0-de76-4df7-a700-c6c79e40e8c7_10.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/221af4c0-de76-4df7-a700-c6c79e40e8c7_10.jpg not downloaded yet
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb0655140-7456-48b9-aa0e-6638426c5791_10.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b0655140-7456-48b9-aa0e-6638426c5791_10.jpg not downloaded yet
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc417bd0e-e9ad-4d21-9c97-d90052b22054_10.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c417bd0e-e9ad-4d21-9c97-d90052b22054_10.jpg not downloaded yet
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F45c612c5-7ee9-412e-8fcd-cca7a96ef77a_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/45c612c5-7ee9-412e-8fcd-cca7a96ef77a_ext_5.jpg not downloaded yet
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F221af4c0-de76-4df7-a700-c6c79e40e8c7_9.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/221af4c0-de76-4df7-a700-c6c79e40e8c7_9.jpg not downloaded yet
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb0655140-7456-48b9-aa0e-6638426c5791_9.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b0655140-7456-48b9-aa0e-6638426c5791_9.jpg not downloaded yet
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc417bd0e-e9ad-4d21-9c97-d90052b22054_9.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c417bd0e-e9ad-4d21-9c97-d90052b22054_9.jpg not downloaded yet
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F45c612c5-7ee9-412e-8fcd-cca7a96ef77a_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/45c612c5-7ee9-412e-8fcd-cca7a96ef77a_ext_3.jpg not downloaded yet
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F221af4c0-de76-4df7-a700-c6c79e40e8c7_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/221af4c0-de76-4df7-a700-c6c79e40e8c7_ext_2.jpg not downloaded yet
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb0655140-7456-48b9-aa0e-6638426c5791_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b0655140-7456-48b9-aa0e-6638426c5791_ext_2.jpg not downloaded yet
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc417bd0e-e9ad-4d21-9c97-d90052b22054_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c417bd0e-e9ad-4d21-9c97-d90052b22054_ext_2.jpg not downloaded yet
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F45c612c5-7ee9-412e-8fcd-cca7a96ef77a_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/45c612c5-7ee9-412e-8fcd-cca7a96ef77a_ext_4.jpg not downloaded yet
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F221af4c0-de76-4df7-a700-c6c79e40e8c7_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/221af4c0-de76-4df7-a700-c6c79e40e8c7_ext_5.jpg not downloaded yet
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb0655140-7456-48b9-aa0e-6638426c5791_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b0655140-7456-48b9-aa0e-6638426c5791_ext_5.jpg not downloaded yet
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc417bd0e-e9ad-4d21-9c97-d90052b22054_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c417bd0e-e9ad-4d21-9c97-d90052b22054_ext_5.jpg not downloaded yet
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3732689-4003546-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3732689-4003546-13.jpg not downloaded yet
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F221af4c0-de76-4df7-a700-c6c79e40e8c7_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/221af4c0-de76-4df7-a700-c6c79e40e8c7_ext_3.jpg not downloaded yet
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb0655140-7456-48b9-aa0e-6638426c5791_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b0655140-7456-48b9-aa0e-6638426c5791_ext_3.jpg not downloaded yet
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc417bd0e-e9ad-4d21-9c97-d90052b22054_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c417bd0e-e9ad-4d21-9c97-d90052b22054_ext_3.jpg not downloaded yet
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3732689-4003546-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3732689-4003546-1000.jpg not downloaded yet
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F221af4c0-de76-4df7-a700-c6c79e40e8c7_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/221af4c0-de76-4df7-a700-c6c79e40e8c7_ext_4.jpg not downloaded yet
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb0655140-7456-48b9-aa0e-6638426c5791_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b0655140-7456-48b9-aa0e-6638426c5791_ext_4.jpg not downloaded yet
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc417bd0e-e9ad-4d21-9c97-d90052b22054_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c417bd0e-e9ad-4d21-9c97-d90052b22054_ext_4.jpg not downloaded yet
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3732689-4003546-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3732689-4003546-1001.jpg not downloaded yet
2025-12-04 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3733236-4004821-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3733236-4004821-13.jpg not downloaded yet
2025-12-04 10:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3753028-3975419-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3753028-3975419-13.jpg not downloaded yet
2025-12-04 10:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3733108-3998908-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3733108-3998908-13.jpg not downloaded yet
2025-12-04 10:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3732689-4003546-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3732689-4003546-1002.jpg not downloaded yet
2025-12-04 10:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3733236-4004821-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3733236-4004821-1000.jpg not downloaded yet
2025-12-04 10:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3753028-3975419-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3753028-3975419-1000.jpg not downloaded yet
2025-12-04 10:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3733108-3998908-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3733108-3998908-1000.jpg not downloaded yet
2025-12-04 10:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3732689-4003546-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3732689-4003546-1003.jpg not downloaded yet
2025-12-04 10:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3733236-4004821-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3733236-4004821-1001.jpg not downloaded yet
2025-12-04 10:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3753028-3975419-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3753028-3975419-1001.jpg not downloaded yet
2025-12-04 10:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3733108-3998908-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3733108-3998908-1001.jpg not downloaded yet
2025-12-04 10:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3732689-4003546-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3732689-4003546-1004.jpg not downloaded yet
2025-12-04 10:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3733236-4004821-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3733236-4004821-1002.jpg not downloaded yet
2025-12-04 10:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3753028-3975419-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3753028-3975419-1002.jpg not downloaded yet
2025-12-04 10:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3733108-3998908-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3733108-3998908-1002.jpg not downloaded yet
2025-12-04 10:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3732689-4003546-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3732689-4003546-1005.jpg not downloaded yet
2025-12-04 10:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3733236-4004821-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3733236-4004821-1003.jpg not downloaded yet
2025-12-04 10:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3753028-3975419-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3753028-3975419-1003.jpg not downloaded yet
2025-12-04 10:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3733108-3998908-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3733108-3998908-1003.jpg not downloaded yet
2025-12-04 10:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3733236-4004821-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3733236-4004821-1004.jpg not downloaded yet
2025-12-04 10:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3753028-3975419-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3753028-3975419-1004.jpg not downloaded yet
2025-12-04 10:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3733108-3998908-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3733108-3998908-1004.jpg not downloaded yet
2025-12-04 10:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3733236-4004821-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3733236-4004821-1005.jpg not downloaded yet
2025-12-04 10:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3753028-3975419-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3753028-3975419-1005.jpg not downloaded yet
2025-12-04 10:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3733108-3998908-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3733108-3998908-1005.jpg not downloaded yet
2025-12-04 10:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3733108-3998908-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003733108-01985605-002.pdf)
2025-12-04 10:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3733236-4004821-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003733236-01988566-004.pdf)
2025-12-04 10:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3753028-3975419-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003753028-01726675-006.pdf)
2025-12-04 10:06:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc54c450>
2025-12-04 10:06:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:06:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_280bb43a-4e12-593b-bbeb-807f0c52302f/280bb43a-4e12-593b-bbeb-807f0c52302f_image_19.jpg HTTP/1.1" 201 0
2025-12-04 10:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3733108-3998908-1005.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3733108-3998908-1005.jpg saved to cache
2025-12-04 10:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 280bb43a-4e12-593b-bbeb-807f0c52302f
2025-12-04 10:06:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc61be10>
2025-12-04 10:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:06:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd47cf9a-b495-54ed-94b9-5ff59695697b/cd47cf9a-b495-54ed-94b9-5ff59695697b_image_19.jpg HTTP/1.1" 201 0
2025-12-04 10:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3733236-4004821-1005.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3733236-4004821-1005.jpg saved to cache
2025-12-04 10:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item cd47cf9a-b495-54ed-94b9-5ff59695697b
2025-12-04 10:06:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd11c5d0>
2025-12-04 10:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:06:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_672a8c4f-71d8-58f3-8299-077e7dbd1660/672a8c4f-71d8-58f3-8299-077e7dbd1660_image_19.jpg HTTP/1.1" 201 0
2025-12-04 10:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3753028-3975419-1005.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3753028-3975419-1005.jpg saved to cache
2025-12-04 10:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 672a8c4f-71d8-58f3-8299-077e7dbd1660
2025-12-04 10:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3753028-3975419-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003753028-01726675-006.pdf)
2025-12-04 10:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3733236-4004821-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003733236-01988566-004.pdf)
2025-12-04 10:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3733108-3998908-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003733108-01985605-002.pdf)
2025-12-04 10:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3733108-3998908-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003733108-01985605-002.pdf)
2025-12-04 10:06:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6ff490>
2025-12-04 10:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:06:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_672a8c4f-71d8-58f3-8299-077e7dbd1660/672a8c4f-71d8-58f3-8299-077e7dbd1660_image_18.jpg HTTP/1.1" 201 0
2025-12-04 10:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3753028-3975419-1004.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3753028-3975419-1004.jpg saved to cache
2025-12-04 10:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 672a8c4f-71d8-58f3-8299-077e7dbd1660
2025-12-04 10:06:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd4b1d0>
2025-12-04 10:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:06:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd47cf9a-b495-54ed-94b9-5ff59695697b/cd47cf9a-b495-54ed-94b9-5ff59695697b_image_18.jpg HTTP/1.1" 201 0
2025-12-04 10:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3733236-4004821-1004.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3733236-4004821-1004.jpg saved to cache
2025-12-04 10:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item cd47cf9a-b495-54ed-94b9-5ff59695697b
2025-12-04 10:06:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd0a3ad0>
2025-12-04 10:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:06:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_280bb43a-4e12-593b-bbeb-807f0c52302f/280bb43a-4e12-593b-bbeb-807f0c52302f_image_17.jpg HTTP/1.1" 201 0
2025-12-04 10:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3733108-3998908-1003.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3733108-3998908-1003.jpg saved to cache
2025-12-04 10:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 280bb43a-4e12-593b-bbeb-807f0c52302f
2025-12-04 10:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3733236-4004821-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003733236-01988566-004.pdf)
2025-12-04 10:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3732689-4003546-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003732689-01709363-006.pdf)
2025-12-04 10:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3733108-3998908-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003733108-01985605-002.pdf)
2025-12-04 10:06:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc61b650>
2025-12-04 10:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:06:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_280bb43a-4e12-593b-bbeb-807f0c52302f/280bb43a-4e12-593b-bbeb-807f0c52302f_image_18.jpg HTTP/1.1" 201 0
2025-12-04 10:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3733108-3998908-1004.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3733108-3998908-1004.jpg saved to cache
2025-12-04 10:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 280bb43a-4e12-593b-bbeb-807f0c52302f
2025-12-04 10:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3753028-3975419-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003753028-01726675-006.pdf)
2025-12-04 10:06:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cccb9710>
2025-12-04 10:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:06:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd47cf9a-b495-54ed-94b9-5ff59695697b/cd47cf9a-b495-54ed-94b9-5ff59695697b_image_17.jpg HTTP/1.1" 201 0
2025-12-04 10:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3733236-4004821-1003.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3733236-4004821-1003.jpg saved to cache
2025-12-04 10:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item cd47cf9a-b495-54ed-94b9-5ff59695697b
2025-12-04 10:06:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd75b90>
2025-12-04 10:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:06:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d41ca17-91a5-5695-a2ce-4ac7d4eea455/9d41ca17-91a5-5695-a2ce-4ac7d4eea455_image_19.jpg HTTP/1.1" 201 0
2025-12-04 10:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3732689-4003546-1005.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3732689-4003546-1005.jpg saved to cache
2025-12-04 10:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 9d41ca17-91a5-5695-a2ce-4ac7d4eea455
2025-12-04 10:06:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd1fd90>
2025-12-04 10:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:06:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_280bb43a-4e12-593b-bbeb-807f0c52302f/280bb43a-4e12-593b-bbeb-807f0c52302f_image_16.jpg HTTP/1.1" 201 0
2025-12-04 10:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3733108-3998908-1002.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3733108-3998908-1002.jpg saved to cache
2025-12-04 10:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 280bb43a-4e12-593b-bbeb-807f0c52302f
2025-12-04 10:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3733108-3998908-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003733108-01985605-002.pdf)
2025-12-04 10:06:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc719590>
2025-12-04 10:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:06:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_672a8c4f-71d8-58f3-8299-077e7dbd1660/672a8c4f-71d8-58f3-8299-077e7dbd1660_image_17.jpg HTTP/1.1" 201 0
2025-12-04 10:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3753028-3975419-1003.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3753028-3975419-1003.jpg saved to cache
2025-12-04 10:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 672a8c4f-71d8-58f3-8299-077e7dbd1660
2025-12-04 10:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3732689-4003546-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003732689-01709363-006.pdf)
2025-12-04 10:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3733236-4004821-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003733236-01988566-004.pdf)
2025-12-04 10:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3753028-3975419-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003753028-01726675-006.pdf)
2025-12-04 10:06:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce65f90>
2025-12-04 10:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:06:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_280bb43a-4e12-593b-bbeb-807f0c52302f/280bb43a-4e12-593b-bbeb-807f0c52302f_image_15.jpg HTTP/1.1" 201 0
2025-12-04 10:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3733108-3998908-1001.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3733108-3998908-1001.jpg saved to cache
2025-12-04 10:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 280bb43a-4e12-593b-bbeb-807f0c52302f
2025-12-04 10:06:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5730d0>
2025-12-04 10:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:06:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d41ca17-91a5-5695-a2ce-4ac7d4eea455/9d41ca17-91a5-5695-a2ce-4ac7d4eea455_image_18.jpg HTTP/1.1" 201 0
2025-12-04 10:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3732689-4003546-1004.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3732689-4003546-1004.jpg saved to cache
2025-12-04 10:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 9d41ca17-91a5-5695-a2ce-4ac7d4eea455
2025-12-04 10:06:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccc80050>
2025-12-04 10:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 10:06:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd47cf9a-b495-54ed-94b9-5ff59695697b/cd47cf9a-b495-54ed-94b9-5ff59695697b_image_16.jpg HTTP/1.1" 201 0
2025-12-04 10:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3733236-4004821-1002.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3733236-4004821-1002.jpg saved to cache
2025-12-04 10:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item cd47cf9a-b495-54ed-94b9-5ff59695697b
2025-12-04 10:06:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccde91d0>
2025-12-04 10:06:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 10:06:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_672a8c4f-71d8-58f3-8299-077e7dbd1660/672a8c4f-71d8-58f3-8299-077e7dbd1660_image_16.jpg HTTP/1.1" 201 0
2025-12-04 10:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3753028-3975419-1002.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3753028-3975419-1002.jpg saved to cache
2025-12-04 10:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 672a8c4f-71d8-58f3-8299-077e7dbd1660
2025-12-04 10:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3733108-3998908-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003733108-01985605-002.pdf)
2025-12-04 10:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3733236-4004821-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003733236-01988566-004.pdf)
2025-12-04 10:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3732689-4003546-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003732689-01709363-006.pdf)
2025-12-04 10:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3753028-3975419-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003753028-01726675-006.pdf)
2025-12-04 10:06:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf90150>
2025-12-04 10:06:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:06:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_280bb43a-4e12-593b-bbeb-807f0c52302f/280bb43a-4e12-593b-bbeb-807f0c52302f_image_14.jpg HTTP/1.1" 201 0
2025-12-04 10:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3733108-3998908-1000.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3733108-3998908-1000.jpg saved to cache
2025-12-04 10:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 280bb43a-4e12-593b-bbeb-807f0c52302f
2025-12-04 10:06:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce51f50>
2025-12-04 10:06:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:06:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd47cf9a-b495-54ed-94b9-5ff59695697b/cd47cf9a-b495-54ed-94b9-5ff59695697b_image_15.jpg HTTP/1.1" 201 0
2025-12-04 10:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3733236-4004821-1001.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3733236-4004821-1001.jpg saved to cache
2025-12-04 10:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item cd47cf9a-b495-54ed-94b9-5ff59695697b
2025-12-04 10:06:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc72d450>
2025-12-04 10:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:06:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d41ca17-91a5-5695-a2ce-4ac7d4eea455/9d41ca17-91a5-5695-a2ce-4ac7d4eea455_image_17.jpg HTTP/1.1" 201 0
2025-12-04 10:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3732689-4003546-1003.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3732689-4003546-1003.jpg saved to cache
2025-12-04 10:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 9d41ca17-91a5-5695-a2ce-4ac7d4eea455
2025-12-04 10:06:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd90f10>
2025-12-04 10:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:06:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_672a8c4f-71d8-58f3-8299-077e7dbd1660/672a8c4f-71d8-58f3-8299-077e7dbd1660_image_15.jpg HTTP/1.1" 201 0
2025-12-04 10:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3753028-3975419-1001.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3753028-3975419-1001.jpg saved to cache
2025-12-04 10:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 672a8c4f-71d8-58f3-8299-077e7dbd1660
2025-12-04 10:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3733236-4004821-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003733236-01988566-004.pdf)
2025-12-04 10:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3732689-4003546-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003732689-01709363-006.pdf)
2025-12-04 10:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3753028-3975419-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003753028-01726675-006.pdf)
2025-12-04 10:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3733108-3998908-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003733108-01985605-002.pdf)
2025-12-04 10:06:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc610610>
2025-12-04 10:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:06:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd47cf9a-b495-54ed-94b9-5ff59695697b/cd47cf9a-b495-54ed-94b9-5ff59695697b_image_14.jpg HTTP/1.1" 201 0
2025-12-04 10:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3733236-4004821-1000.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3733236-4004821-1000.jpg saved to cache
2025-12-04 10:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item cd47cf9a-b495-54ed-94b9-5ff59695697b
2025-12-04 10:06:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd4bbd0>
2025-12-04 10:06:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:06:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d41ca17-91a5-5695-a2ce-4ac7d4eea455/9d41ca17-91a5-5695-a2ce-4ac7d4eea455_image_16.jpg HTTP/1.1" 201 0
2025-12-04 10:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3732689-4003546-1002.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3732689-4003546-1002.jpg saved to cache
2025-12-04 10:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 9d41ca17-91a5-5695-a2ce-4ac7d4eea455
2025-12-04 10:06:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cccab190>
2025-12-04 10:06:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:06:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_672a8c4f-71d8-58f3-8299-077e7dbd1660/672a8c4f-71d8-58f3-8299-077e7dbd1660_image_14.jpg HTTP/1.1" 201 0
2025-12-04 10:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3753028-3975419-1000.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3753028-3975419-1000.jpg saved to cache
2025-12-04 10:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 672a8c4f-71d8-58f3-8299-077e7dbd1660
2025-12-04 10:06:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccfd3bd0>
2025-12-04 10:06:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:06:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_280bb43a-4e12-593b-bbeb-807f0c52302f/280bb43a-4e12-593b-bbeb-807f0c52302f_image_13.jpg HTTP/1.1" 201 0
2025-12-04 10:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3733108-3998908-13.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3733108-3998908-13.jpg saved to cache
2025-12-04 10:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 280bb43a-4e12-593b-bbeb-807f0c52302f
2025-12-04 10:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3732689-4003546-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003732689-01709363-006.pdf)
2025-12-04 10:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3753028-3975419-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003753028-01726675-006.pdf)
2025-12-04 10:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c417bd0e-e9ad-4d21-9c97-d90052b22054_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003733108-01985605-002.pdf)
2025-12-04 10:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3733236-4004821-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003733236-01988566-004.pdf)
2025-12-04 10:06:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce26490>
2025-12-04 10:06:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:06:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d41ca17-91a5-5695-a2ce-4ac7d4eea455/9d41ca17-91a5-5695-a2ce-4ac7d4eea455_image_15.jpg HTTP/1.1" 201 0
2025-12-04 10:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3732689-4003546-1001.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3732689-4003546-1001.jpg saved to cache
2025-12-04 10:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 9d41ca17-91a5-5695-a2ce-4ac7d4eea455
2025-12-04 10:06:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce91210>
2025-12-04 10:06:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:06:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_672a8c4f-71d8-58f3-8299-077e7dbd1660/672a8c4f-71d8-58f3-8299-077e7dbd1660_image_13.jpg HTTP/1.1" 201 0
2025-12-04 10:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3753028-3975419-13.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3753028-3975419-13.jpg saved to cache
2025-12-04 10:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 672a8c4f-71d8-58f3-8299-077e7dbd1660
2025-12-04 10:06:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf69150>
2025-12-04 10:06:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:06:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_280bb43a-4e12-593b-bbeb-807f0c52302f/280bb43a-4e12-593b-bbeb-807f0c52302f_image_12.jpg HTTP/1.1" 201 0
2025-12-04 10:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc417bd0e-e9ad-4d21-9c97-d90052b22054_ext_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c417bd0e-e9ad-4d21-9c97-d90052b22054_ext_4.jpg saved to cache
2025-12-04 10:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 280bb43a-4e12-593b-bbeb-807f0c52302f
2025-12-04 10:06:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd0a3350>
2025-12-04 10:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:06:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd47cf9a-b495-54ed-94b9-5ff59695697b/cd47cf9a-b495-54ed-94b9-5ff59695697b_image_13.jpg HTTP/1.1" 201 0
2025-12-04 10:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3733236-4004821-13.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3733236-4004821-13.jpg saved to cache
2025-12-04 10:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item cd47cf9a-b495-54ed-94b9-5ff59695697b
2025-12-04 10:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/b0655140-7456-48b9-aa0e-6638426c5791_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003753028-01726675-006.pdf)
2025-12-04 10:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3732689-4003546-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003732689-01709363-006.pdf)
2025-12-04 10:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/221af4c0-de76-4df7-a700-c6c79e40e8c7_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003733236-01988566-004.pdf)
2025-12-04 10:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c417bd0e-e9ad-4d21-9c97-d90052b22054_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003733108-01985605-002.pdf)
2025-12-04 10:06:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf094d0>
2025-12-04 10:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:06:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_672a8c4f-71d8-58f3-8299-077e7dbd1660/672a8c4f-71d8-58f3-8299-077e7dbd1660_image_12.jpg HTTP/1.1" 201 0
2025-12-04 10:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb0655140-7456-48b9-aa0e-6638426c5791_ext_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b0655140-7456-48b9-aa0e-6638426c5791_ext_4.jpg saved to cache
2025-12-04 10:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 672a8c4f-71d8-58f3-8299-077e7dbd1660
2025-12-04 10:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/b0655140-7456-48b9-aa0e-6638426c5791_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003753028-01726675-006.pdf)
2025-12-04 10:06:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccced790>
2025-12-04 10:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:06:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d41ca17-91a5-5695-a2ce-4ac7d4eea455/9d41ca17-91a5-5695-a2ce-4ac7d4eea455_image_14.jpg HTTP/1.1" 201 0
2025-12-04 10:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3732689-4003546-1000.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3732689-4003546-1000.jpg saved to cache
2025-12-04 10:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 9d41ca17-91a5-5695-a2ce-4ac7d4eea455
2025-12-04 10:06:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf5b610>
2025-12-04 10:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:06:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd47cf9a-b495-54ed-94b9-5ff59695697b/cd47cf9a-b495-54ed-94b9-5ff59695697b_image_12.jpg HTTP/1.1" 201 0
2025-12-04 10:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F221af4c0-de76-4df7-a700-c6c79e40e8c7_ext_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/221af4c0-de76-4df7-a700-c6c79e40e8c7_ext_4.jpg saved to cache
2025-12-04 10:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item cd47cf9a-b495-54ed-94b9-5ff59695697b
2025-12-04 10:06:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cccec190>
2025-12-04 10:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:06:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_280bb43a-4e12-593b-bbeb-807f0c52302f/280bb43a-4e12-593b-bbeb-807f0c52302f_image_11.jpg HTTP/1.1" 201 0
2025-12-04 10:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc417bd0e-e9ad-4d21-9c97-d90052b22054_ext_3.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c417bd0e-e9ad-4d21-9c97-d90052b22054_ext_3.jpg saved to cache
2025-12-04 10:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 280bb43a-4e12-593b-bbeb-807f0c52302f
2025-12-04 10:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c417bd0e-e9ad-4d21-9c97-d90052b22054_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003733108-01985605-002.pdf)
2025-12-04 10:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/221af4c0-de76-4df7-a700-c6c79e40e8c7_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003733236-01988566-004.pdf)
2025-12-04 10:06:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce77490>
2025-12-04 10:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:06:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_672a8c4f-71d8-58f3-8299-077e7dbd1660/672a8c4f-71d8-58f3-8299-077e7dbd1660_image_11.jpg HTTP/1.1" 201 0
2025-12-04 10:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb0655140-7456-48b9-aa0e-6638426c5791_ext_3.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b0655140-7456-48b9-aa0e-6638426c5791_ext_3.jpg saved to cache
2025-12-04 10:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 672a8c4f-71d8-58f3-8299-077e7dbd1660
2025-12-04 10:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3732689-4003546-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003732689-01709363-006.pdf)
2025-12-04 10:06:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd0f4610>
2025-12-04 10:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_280bb43a-4e12-593b-bbeb-807f0c52302f/280bb43a-4e12-593b-bbeb-807f0c52302f_image_10.jpg HTTP/1.1" 201 0
2025-12-04 10:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc417bd0e-e9ad-4d21-9c97-d90052b22054_ext_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c417bd0e-e9ad-4d21-9c97-d90052b22054_ext_5.jpg saved to cache
2025-12-04 10:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 280bb43a-4e12-593b-bbeb-807f0c52302f
2025-12-04 10:06:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc69afd0>
2025-12-04 10:06:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd47cf9a-b495-54ed-94b9-5ff59695697b/cd47cf9a-b495-54ed-94b9-5ff59695697b_image_11.jpg HTTP/1.1" 201 0
2025-12-04 10:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F221af4c0-de76-4df7-a700-c6c79e40e8c7_ext_3.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/221af4c0-de76-4df7-a700-c6c79e40e8c7_ext_3.jpg saved to cache
2025-12-04 10:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item cd47cf9a-b495-54ed-94b9-5ff59695697b
2025-12-04 10:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/b0655140-7456-48b9-aa0e-6638426c5791_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003753028-01726675-006.pdf)
2025-12-04 10:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/45c612c5-7ee9-412e-8fcd-cca7a96ef77a_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003732689-01709363-006.pdf)
2025-12-04 10:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/221af4c0-de76-4df7-a700-c6c79e40e8c7_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003733236-01988566-004.pdf)
2025-12-04 10:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c417bd0e-e9ad-4d21-9c97-d90052b22054_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003733108-01985605-002.pdf)
2025-12-04 10:06:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccc75ed0>
2025-12-04 10:06:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d41ca17-91a5-5695-a2ce-4ac7d4eea455/9d41ca17-91a5-5695-a2ce-4ac7d4eea455_image_13.jpg HTTP/1.1" 201 0
2025-12-04 10:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3732689-4003546-13.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3732689-4003546-13.jpg saved to cache
2025-12-04 10:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 9d41ca17-91a5-5695-a2ce-4ac7d4eea455
2025-12-04 10:06:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5af110>
2025-12-04 10:06:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_672a8c4f-71d8-58f3-8299-077e7dbd1660/672a8c4f-71d8-58f3-8299-077e7dbd1660_image_10.jpg HTTP/1.1" 201 0
2025-12-04 10:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb0655140-7456-48b9-aa0e-6638426c5791_ext_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b0655140-7456-48b9-aa0e-6638426c5791_ext_5.jpg saved to cache
2025-12-04 10:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 672a8c4f-71d8-58f3-8299-077e7dbd1660
2025-12-04 10:06:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd009c50>
2025-12-04 10:06:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:06:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d41ca17-91a5-5695-a2ce-4ac7d4eea455/9d41ca17-91a5-5695-a2ce-4ac7d4eea455_image_12.jpg HTTP/1.1" 201 0
2025-12-04 10:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F45c612c5-7ee9-412e-8fcd-cca7a96ef77a_ext_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/45c612c5-7ee9-412e-8fcd-cca7a96ef77a_ext_4.jpg saved to cache
2025-12-04 10:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 9d41ca17-91a5-5695-a2ce-4ac7d4eea455
2025-12-04 10:06:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6f2510>
2025-12-04 10:06:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:06:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd47cf9a-b495-54ed-94b9-5ff59695697b/cd47cf9a-b495-54ed-94b9-5ff59695697b_image_10.jpg HTTP/1.1" 201 0
2025-12-04 10:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F221af4c0-de76-4df7-a700-c6c79e40e8c7_ext_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/221af4c0-de76-4df7-a700-c6c79e40e8c7_ext_5.jpg saved to cache
2025-12-04 10:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item cd47cf9a-b495-54ed-94b9-5ff59695697b
2025-12-04 10:06:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccfcdf50>
2025-12-04 10:06:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:06:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_280bb43a-4e12-593b-bbeb-807f0c52302f/280bb43a-4e12-593b-bbeb-807f0c52302f_image_9.jpg HTTP/1.1" 201 0
2025-12-04 10:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc417bd0e-e9ad-4d21-9c97-d90052b22054_ext_2.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c417bd0e-e9ad-4d21-9c97-d90052b22054_ext_2.jpg saved to cache
2025-12-04 10:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 280bb43a-4e12-593b-bbeb-807f0c52302f
2025-12-04 10:06:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c417bd0e-e9ad-4d21-9c97-d90052b22054_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003733108-01985605-002.pdf)
2025-12-04 10:06:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/45c612c5-7ee9-412e-8fcd-cca7a96ef77a_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003732689-01709363-006.pdf)
2025-12-04 10:06:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/b0655140-7456-48b9-aa0e-6638426c5791_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003753028-01726675-006.pdf)
2025-12-04 10:06:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/221af4c0-de76-4df7-a700-c6c79e40e8c7_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003733236-01988566-004.pdf)
2025-12-04 10:06:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc71b790>
2025-12-04 10:06:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:06:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_280bb43a-4e12-593b-bbeb-807f0c52302f/280bb43a-4e12-593b-bbeb-807f0c52302f_image_8.jpg HTTP/1.1" 201 0
2025-12-04 10:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc417bd0e-e9ad-4d21-9c97-d90052b22054_9.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c417bd0e-e9ad-4d21-9c97-d90052b22054_9.jpg saved to cache
2025-12-04 10:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 280bb43a-4e12-593b-bbeb-807f0c52302f
2025-12-04 10:06:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccedb550>
2025-12-04 10:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:06:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d41ca17-91a5-5695-a2ce-4ac7d4eea455/9d41ca17-91a5-5695-a2ce-4ac7d4eea455_image_11.jpg HTTP/1.1" 201 0
2025-12-04 10:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F45c612c5-7ee9-412e-8fcd-cca7a96ef77a_ext_3.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/45c612c5-7ee9-412e-8fcd-cca7a96ef77a_ext_3.jpg saved to cache
2025-12-04 10:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 9d41ca17-91a5-5695-a2ce-4ac7d4eea455
2025-12-04 10:06:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccec7850>
2025-12-04 10:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:06:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_672a8c4f-71d8-58f3-8299-077e7dbd1660/672a8c4f-71d8-58f3-8299-077e7dbd1660_image_9.jpg HTTP/1.1" 201 0
2025-12-04 10:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb0655140-7456-48b9-aa0e-6638426c5791_ext_2.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b0655140-7456-48b9-aa0e-6638426c5791_ext_2.jpg saved to cache
2025-12-04 10:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 672a8c4f-71d8-58f3-8299-077e7dbd1660
2025-12-04 10:06:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccec5d10>
2025-12-04 10:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:06:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd47cf9a-b495-54ed-94b9-5ff59695697b/cd47cf9a-b495-54ed-94b9-5ff59695697b_image_9.jpg HTTP/1.1" 201 0
2025-12-04 10:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F221af4c0-de76-4df7-a700-c6c79e40e8c7_ext_2.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/221af4c0-de76-4df7-a700-c6c79e40e8c7_ext_2.jpg saved to cache
2025-12-04 10:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cd47cf9a-b495-54ed-94b9-5ff59695697b
2025-12-04 10:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/b0655140-7456-48b9-aa0e-6638426c5791_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003753028-01726675-006.pdf)
2025-12-04 10:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c417bd0e-e9ad-4d21-9c97-d90052b22054_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003733108-01985605-002.pdf)
2025-12-04 10:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/221af4c0-de76-4df7-a700-c6c79e40e8c7_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003733236-01988566-004.pdf)
2025-12-04 10:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/45c612c5-7ee9-412e-8fcd-cca7a96ef77a_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003732689-01709363-006.pdf)
2025-12-04 10:06:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ce7bccd0>
2025-12-04 10:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:06:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_672a8c4f-71d8-58f3-8299-077e7dbd1660/672a8c4f-71d8-58f3-8299-077e7dbd1660_image_8.jpg HTTP/1.1" 201 0
2025-12-04 10:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb0655140-7456-48b9-aa0e-6638426c5791_9.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b0655140-7456-48b9-aa0e-6638426c5791_9.jpg saved to cache
2025-12-04 10:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 672a8c4f-71d8-58f3-8299-077e7dbd1660
2025-12-04 10:06:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cccda710>
2025-12-04 10:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:06:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_280bb43a-4e12-593b-bbeb-807f0c52302f/280bb43a-4e12-593b-bbeb-807f0c52302f_image_7.jpg HTTP/1.1" 201 0
2025-12-04 10:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc417bd0e-e9ad-4d21-9c97-d90052b22054_10.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c417bd0e-e9ad-4d21-9c97-d90052b22054_10.jpg saved to cache
2025-12-04 10:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 280bb43a-4e12-593b-bbeb-807f0c52302f
2025-12-04 10:06:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccced510>
2025-12-04 10:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:06:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd47cf9a-b495-54ed-94b9-5ff59695697b/cd47cf9a-b495-54ed-94b9-5ff59695697b_image_8.jpg HTTP/1.1" 201 0
2025-12-04 10:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F221af4c0-de76-4df7-a700-c6c79e40e8c7_9.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/221af4c0-de76-4df7-a700-c6c79e40e8c7_9.jpg saved to cache
2025-12-04 10:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cd47cf9a-b495-54ed-94b9-5ff59695697b
2025-12-04 10:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/b0655140-7456-48b9-aa0e-6638426c5791_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003753028-01726675-006.pdf)
2025-12-04 10:06:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6fac90>
2025-12-04 10:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:06:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d41ca17-91a5-5695-a2ce-4ac7d4eea455/9d41ca17-91a5-5695-a2ce-4ac7d4eea455_image_10.jpg HTTP/1.1" 201 0
2025-12-04 10:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F45c612c5-7ee9-412e-8fcd-cca7a96ef77a_ext_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/45c612c5-7ee9-412e-8fcd-cca7a96ef77a_ext_5.jpg saved to cache
2025-12-04 10:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 9d41ca17-91a5-5695-a2ce-4ac7d4eea455
2025-12-04 10:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/221af4c0-de76-4df7-a700-c6c79e40e8c7_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003733236-01988566-004.pdf)
2025-12-04 10:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c417bd0e-e9ad-4d21-9c97-d90052b22054_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003733108-01985605-002.pdf)
2025-12-04 10:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/45c612c5-7ee9-412e-8fcd-cca7a96ef77a_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003732689-01709363-006.pdf)
2025-12-04 10:06:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6e63d0>
2025-12-04 10:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:06:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_672a8c4f-71d8-58f3-8299-077e7dbd1660/672a8c4f-71d8-58f3-8299-077e7dbd1660_image_7.jpg HTTP/1.1" 201 0
2025-12-04 10:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb0655140-7456-48b9-aa0e-6638426c5791_10.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b0655140-7456-48b9-aa0e-6638426c5791_10.jpg saved to cache
2025-12-04 10:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 672a8c4f-71d8-58f3-8299-077e7dbd1660
2025-12-04 10:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/b0655140-7456-48b9-aa0e-6638426c5791_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003753028-01726675-006.pdf)
2025-12-04 10:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c417bd0e-e9ad-4d21-9c97-d90052b22054_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003733108-01985605-002.pdf)
2025-12-04 10:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/221af4c0-de76-4df7-a700-c6c79e40e8c7_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003733236-01988566-004.pdf)
2025-12-04 10:06:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5bcf10>
2025-12-04 10:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:06:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd47cf9a-b495-54ed-94b9-5ff59695697b/cd47cf9a-b495-54ed-94b9-5ff59695697b_image_7.jpg HTTP/1.1" 201 0
2025-12-04 10:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F221af4c0-de76-4df7-a700-c6c79e40e8c7_10.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/221af4c0-de76-4df7-a700-c6c79e40e8c7_10.jpg saved to cache
2025-12-04 10:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cd47cf9a-b495-54ed-94b9-5ff59695697b
2025-12-04 10:06:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ce7f8250>
2025-12-04 10:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:06:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_280bb43a-4e12-593b-bbeb-807f0c52302f/280bb43a-4e12-593b-bbeb-807f0c52302f_image_6.jpg HTTP/1.1" 201 0
2025-12-04 10:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc417bd0e-e9ad-4d21-9c97-d90052b22054_11.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c417bd0e-e9ad-4d21-9c97-d90052b22054_11.jpg saved to cache
2025-12-04 10:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 280bb43a-4e12-593b-bbeb-807f0c52302f
2025-12-04 10:06:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc71bb50>
2025-12-04 10:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:06:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d41ca17-91a5-5695-a2ce-4ac7d4eea455/9d41ca17-91a5-5695-a2ce-4ac7d4eea455_image_9.jpg HTTP/1.1" 201 0
2025-12-04 10:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F45c612c5-7ee9-412e-8fcd-cca7a96ef77a_ext_2.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/45c612c5-7ee9-412e-8fcd-cca7a96ef77a_ext_2.jpg saved to cache
2025-12-04 10:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9d41ca17-91a5-5695-a2ce-4ac7d4eea455
2025-12-04 10:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/45c612c5-7ee9-412e-8fcd-cca7a96ef77a_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003732689-01709363-006.pdf)
2025-12-04 10:06:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc54ccd0>
2025-12-04 10:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:06:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_672a8c4f-71d8-58f3-8299-077e7dbd1660/672a8c4f-71d8-58f3-8299-077e7dbd1660_image_6.jpg HTTP/1.1" 201 0
2025-12-04 10:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb0655140-7456-48b9-aa0e-6638426c5791_11.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b0655140-7456-48b9-aa0e-6638426c5791_11.jpg saved to cache
2025-12-04 10:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 672a8c4f-71d8-58f3-8299-077e7dbd1660
2025-12-04 10:06:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc67ef50>
2025-12-04 10:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:06:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_280bb43a-4e12-593b-bbeb-807f0c52302f/280bb43a-4e12-593b-bbeb-807f0c52302f_image_5.jpg HTTP/1.1" 201 0
2025-12-04 10:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc417bd0e-e9ad-4d21-9c97-d90052b22054_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c417bd0e-e9ad-4d21-9c97-d90052b22054_4.jpg saved to cache
2025-12-04 10:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 280bb43a-4e12-593b-bbeb-807f0c52302f
2025-12-04 10:06:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc718650>
2025-12-04 10:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:06:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd47cf9a-b495-54ed-94b9-5ff59695697b/cd47cf9a-b495-54ed-94b9-5ff59695697b_image_6.jpg HTTP/1.1" 201 0
2025-12-04 10:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F221af4c0-de76-4df7-a700-c6c79e40e8c7_11.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/221af4c0-de76-4df7-a700-c6c79e40e8c7_11.jpg saved to cache
2025-12-04 10:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cd47cf9a-b495-54ed-94b9-5ff59695697b
2025-12-04 10:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/b0655140-7456-48b9-aa0e-6638426c5791_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003753028-01726675-006.pdf)
2025-12-04 10:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c417bd0e-e9ad-4d21-9c97-d90052b22054_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003733108-01985605-002.pdf)
2025-12-04 10:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/221af4c0-de76-4df7-a700-c6c79e40e8c7_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003733236-01988566-004.pdf)
2025-12-04 10:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/45c612c5-7ee9-412e-8fcd-cca7a96ef77a_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003732689-01709363-006.pdf)
2025-12-04 10:06:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf90c50>
2025-12-04 10:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:06:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d41ca17-91a5-5695-a2ce-4ac7d4eea455/9d41ca17-91a5-5695-a2ce-4ac7d4eea455_image_8.jpg HTTP/1.1" 201 0
2025-12-04 10:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F45c612c5-7ee9-412e-8fcd-cca7a96ef77a_9.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/45c612c5-7ee9-412e-8fcd-cca7a96ef77a_9.jpg saved to cache
2025-12-04 10:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9d41ca17-91a5-5695-a2ce-4ac7d4eea455
2025-12-04 10:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/b0655140-7456-48b9-aa0e-6638426c5791_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003753028-01726675-006.pdf)
2025-12-04 10:06:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccc4bad0>
2025-12-04 10:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 10:06:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_672a8c4f-71d8-58f3-8299-077e7dbd1660/672a8c4f-71d8-58f3-8299-077e7dbd1660_image_5.jpg HTTP/1.1" 201 0
2025-12-04 10:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb0655140-7456-48b9-aa0e-6638426c5791_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b0655140-7456-48b9-aa0e-6638426c5791_4.jpg saved to cache
2025-12-04 10:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 672a8c4f-71d8-58f3-8299-077e7dbd1660
2025-12-04 10:06:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc7c9c50>
2025-12-04 10:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:06:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_280bb43a-4e12-593b-bbeb-807f0c52302f/280bb43a-4e12-593b-bbeb-807f0c52302f_image_4.jpg HTTP/1.1" 201 0
2025-12-04 10:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc417bd0e-e9ad-4d21-9c97-d90052b22054_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c417bd0e-e9ad-4d21-9c97-d90052b22054_5.jpg saved to cache
2025-12-04 10:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 280bb43a-4e12-593b-bbeb-807f0c52302f
2025-12-04 10:06:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6e3f10>
2025-12-04 10:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:06:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd47cf9a-b495-54ed-94b9-5ff59695697b/cd47cf9a-b495-54ed-94b9-5ff59695697b_image_5.jpg HTTP/1.1" 201 0
2025-12-04 10:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F221af4c0-de76-4df7-a700-c6c79e40e8c7_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/221af4c0-de76-4df7-a700-c6c79e40e8c7_4.jpg saved to cache
2025-12-04 10:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cd47cf9a-b495-54ed-94b9-5ff59695697b
2025-12-04 10:06:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccc74610>
2025-12-04 10:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 10:06:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d41ca17-91a5-5695-a2ce-4ac7d4eea455/9d41ca17-91a5-5695-a2ce-4ac7d4eea455_image_7.jpg HTTP/1.1" 201 0
2025-12-04 10:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F45c612c5-7ee9-412e-8fcd-cca7a96ef77a_10.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/45c612c5-7ee9-412e-8fcd-cca7a96ef77a_10.jpg saved to cache
2025-12-04 10:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9d41ca17-91a5-5695-a2ce-4ac7d4eea455
2025-12-04 10:06:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccca9610>
2025-12-04 10:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:06:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_672a8c4f-71d8-58f3-8299-077e7dbd1660/672a8c4f-71d8-58f3-8299-077e7dbd1660_image_4.jpg HTTP/1.1" 201 0
2025-12-04 10:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb0655140-7456-48b9-aa0e-6638426c5791_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b0655140-7456-48b9-aa0e-6638426c5791_5.jpg saved to cache
2025-12-04 10:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 672a8c4f-71d8-58f3-8299-077e7dbd1660
2025-12-04 10:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/221af4c0-de76-4df7-a700-c6c79e40e8c7_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003733236-01988566-004.pdf)
2025-12-04 10:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c417bd0e-e9ad-4d21-9c97-d90052b22054_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003733108-01985605-002.pdf)
2025-12-04 10:06:26 [scrapy.extensions.logstats] INFO: Crawled 100 pages (at 5 pages/min), scraped 22 items (at 7 items/min)
2025-12-04 10:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/45c612c5-7ee9-412e-8fcd-cca7a96ef77a_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003732689-01709363-006.pdf)
2025-12-04 10:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/b0655140-7456-48b9-aa0e-6638426c5791_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003753028-01726675-006.pdf)
2025-12-04 10:06:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5beed0>
2025-12-04 10:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:06:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd47cf9a-b495-54ed-94b9-5ff59695697b/cd47cf9a-b495-54ed-94b9-5ff59695697b_image_4.jpg HTTP/1.1" 201 0
2025-12-04 10:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F221af4c0-de76-4df7-a700-c6c79e40e8c7_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/221af4c0-de76-4df7-a700-c6c79e40e8c7_5.jpg saved to cache
2025-12-04 10:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cd47cf9a-b495-54ed-94b9-5ff59695697b
2025-12-04 10:06:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccc76690>
2025-12-04 10:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:06:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_280bb43a-4e12-593b-bbeb-807f0c52302f/280bb43a-4e12-593b-bbeb-807f0c52302f_image_3.jpg HTTP/1.1" 201 0
2025-12-04 10:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc417bd0e-e9ad-4d21-9c97-d90052b22054_ext_1.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c417bd0e-e9ad-4d21-9c97-d90052b22054_ext_1.jpg saved to cache
2025-12-04 10:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 280bb43a-4e12-593b-bbeb-807f0c52302f
2025-12-04 10:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/b0655140-7456-48b9-aa0e-6638426c5791_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003753028-01726675-006.pdf)
2025-12-04 10:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c417bd0e-e9ad-4d21-9c97-d90052b22054_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003733108-01985605-002.pdf)
2025-12-04 10:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/221af4c0-de76-4df7-a700-c6c79e40e8c7_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003733236-01988566-004.pdf)
2025-12-04 10:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/45c612c5-7ee9-412e-8fcd-cca7a96ef77a_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003732689-01709363-006.pdf)
2025-12-04 10:06:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6e20d0>
2025-12-04 10:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d41ca17-91a5-5695-a2ce-4ac7d4eea455/9d41ca17-91a5-5695-a2ce-4ac7d4eea455_image_6.jpg HTTP/1.1" 201 0
2025-12-04 10:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F45c612c5-7ee9-412e-8fcd-cca7a96ef77a_11.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/45c612c5-7ee9-412e-8fcd-cca7a96ef77a_11.jpg saved to cache
2025-12-04 10:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9d41ca17-91a5-5695-a2ce-4ac7d4eea455
2025-12-04 10:06:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6fafd0>
2025-12-04 10:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_672a8c4f-71d8-58f3-8299-077e7dbd1660/672a8c4f-71d8-58f3-8299-077e7dbd1660_image_3.jpg HTTP/1.1" 201 0
2025-12-04 10:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb0655140-7456-48b9-aa0e-6638426c5791_ext_1.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b0655140-7456-48b9-aa0e-6638426c5791_ext_1.jpg saved to cache
2025-12-04 10:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 672a8c4f-71d8-58f3-8299-077e7dbd1660
2025-12-04 10:06:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccdf6750>
2025-12-04 10:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_672a8c4f-71d8-58f3-8299-077e7dbd1660/672a8c4f-71d8-58f3-8299-077e7dbd1660_image_2.jpg HTTP/1.1" 201 0
2025-12-04 10:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb0655140-7456-48b9-aa0e-6638426c5791_ext_6.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b0655140-7456-48b9-aa0e-6638426c5791_ext_6.jpg saved to cache
2025-12-04 10:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 672a8c4f-71d8-58f3-8299-077e7dbd1660
2025-12-04 10:06:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd8ab10>
2025-12-04 10:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_280bb43a-4e12-593b-bbeb-807f0c52302f/280bb43a-4e12-593b-bbeb-807f0c52302f_image_2.jpg HTTP/1.1" 201 0
2025-12-04 10:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc417bd0e-e9ad-4d21-9c97-d90052b22054_ext_6.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c417bd0e-e9ad-4d21-9c97-d90052b22054_ext_6.jpg saved to cache
2025-12-04 10:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 280bb43a-4e12-593b-bbeb-807f0c52302f
2025-12-04 10:06:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccfc2e50>
2025-12-04 10:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:06:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd47cf9a-b495-54ed-94b9-5ff59695697b/cd47cf9a-b495-54ed-94b9-5ff59695697b_image_3.jpg HTTP/1.1" 201 0
2025-12-04 10:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F221af4c0-de76-4df7-a700-c6c79e40e8c7_ext_1.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/221af4c0-de76-4df7-a700-c6c79e40e8c7_ext_1.jpg saved to cache
2025-12-04 10:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cd47cf9a-b495-54ed-94b9-5ff59695697b
2025-12-04 10:06:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd76710>
2025-12-04 10:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:06:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d41ca17-91a5-5695-a2ce-4ac7d4eea455/9d41ca17-91a5-5695-a2ce-4ac7d4eea455_image_5.jpg HTTP/1.1" 201 0
2025-12-04 10:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F45c612c5-7ee9-412e-8fcd-cca7a96ef77a_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/45c612c5-7ee9-412e-8fcd-cca7a96ef77a_4.jpg saved to cache
2025-12-04 10:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9d41ca17-91a5-5695-a2ce-4ac7d4eea455
2025-12-04 10:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=3721892&returnUrl=%2Fsearch%3FPage%3D4%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233721892&indx=352> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 10:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/b0655140-7456-48b9-aa0e-6638426c5791_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003753028-01726675-006.pdf)
2025-12-04 10:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c417bd0e-e9ad-4d21-9c97-d90052b22054_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003733108-01985605-002.pdf)
2025-12-04 10:06:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 10:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/221af4c0-de76-4df7-a700-c6c79e40e8c7_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003733236-01988566-004.pdf)
2025-12-04 10:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/45c612c5-7ee9-412e-8fcd-cca7a96ef77a_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003732689-01709363-006.pdf)
2025-12-04 10:06:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9eb786ba-30f6-5c6b-8f71-dcbf54908e30 with identifier: 3721892
2025-12-04 10:06:28 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 9eb786ba-30f6-5c6b-8f71-dcbf54908e30
2025-12-04 10:06:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccdeba10>
2025-12-04 10:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:06:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_672a8c4f-71d8-58f3-8299-077e7dbd1660/672a8c4f-71d8-58f3-8299-077e7dbd1660_image_1.jpg HTTP/1.1" 201 0
2025-12-04 10:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb0655140-7456-48b9-aa0e-6638426c5791_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b0655140-7456-48b9-aa0e-6638426c5791_ext_7.jpg saved to cache
2025-12-04 10:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 672a8c4f-71d8-58f3-8299-077e7dbd1660
2025-12-04 10:06:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6f0450>
2025-12-04 10:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:06:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_280bb43a-4e12-593b-bbeb-807f0c52302f/280bb43a-4e12-593b-bbeb-807f0c52302f_image_1.jpg HTTP/1.1" 201 0
2025-12-04 10:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc417bd0e-e9ad-4d21-9c97-d90052b22054_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c417bd0e-e9ad-4d21-9c97-d90052b22054_ext_7.jpg saved to cache
2025-12-04 10:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 280bb43a-4e12-593b-bbeb-807f0c52302f
2025-12-04 10:06:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5acfd0>
2025-12-04 10:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:06:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd47cf9a-b495-54ed-94b9-5ff59695697b/cd47cf9a-b495-54ed-94b9-5ff59695697b_image_2.jpg HTTP/1.1" 201 0
2025-12-04 10:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F221af4c0-de76-4df7-a700-c6c79e40e8c7_ext_6.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/221af4c0-de76-4df7-a700-c6c79e40e8c7_ext_6.jpg saved to cache
2025-12-04 10:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cd47cf9a-b495-54ed-94b9-5ff59695697b
2025-12-04 10:06:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc7dc610>
2025-12-04 10:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:06:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d41ca17-91a5-5695-a2ce-4ac7d4eea455/9d41ca17-91a5-5695-a2ce-4ac7d4eea455_image_4.jpg HTTP/1.1" 201 0
2025-12-04 10:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F45c612c5-7ee9-412e-8fcd-cca7a96ef77a_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/45c612c5-7ee9-412e-8fcd-cca7a96ef77a_5.jpg saved to cache
2025-12-04 10:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9d41ca17-91a5-5695-a2ce-4ac7d4eea455
2025-12-04 10:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c417bd0e-e9ad-4d21-9c97-d90052b22054_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003733108-01985605-002.pdf)
2025-12-04 10:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/45c612c5-7ee9-412e-8fcd-cca7a96ef77a_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003732689-01709363-006.pdf)
2025-12-04 10:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/b0655140-7456-48b9-aa0e-6638426c5791_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003753028-01726675-006.pdf)
2025-12-04 10:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/221af4c0-de76-4df7-a700-c6c79e40e8c7_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003733236-01988566-004.pdf)
2025-12-04 10:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/221af4c0-de76-4df7-a700-c6c79e40e8c7_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003733236-01988566-004.pdf)
2025-12-04 10:06:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc63c750>
2025-12-04 10:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_280bb43a-4e12-593b-bbeb-807f0c52302f/280bb43a-4e12-593b-bbeb-807f0c52302f_image_0.jpg HTTP/1.1" 201 0
2025-12-04 10:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc417bd0e-e9ad-4d21-9c97-d90052b22054_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c417bd0e-e9ad-4d21-9c97-d90052b22054_ext_7.jpg saved to cache
2025-12-04 10:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 280bb43a-4e12-593b-bbeb-807f0c52302f
2025-12-04 10:06:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 280bb43a-4e12-593b-bbeb-807f0c52302f, skipping ID generation
2025-12-04 10:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 280bb43a-4e12-593b-bbeb-807f0c52302f from tracking dictionaries
2025-12-04 10:06:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 280bb43a-4e12-593b-bbeb-807f0c52302f sending to next pipeline
2025-12-04 10:06:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 280bb43a-4e12-593b-bbeb-807f0c52302f, identifier: 3733108
2025-12-04 10:06:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 280bb43a-4e12-593b-bbeb-807f0c52302f with identifier: 3733108
2025-12-04 10:06:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 280bb43a-4e12-593b-bbeb-807f0c52302f with identifier: 3733108
2025-12-04 10:06:30 [scrapy.core.scraper] INFO: Dropped: Dropping expired listing: 280bb43a-4e12-593b-bbeb-807f0c52302f with expiration date: 2025-12-04T09:00:00Z
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_280bb43a-4e12-593b-bbeb-807f0c52302f/280bb43a-4e12-593b-bbeb-807f0c52302f_expert_report_file_383d1505-dcc7-4ee3-be7a-a0f837b3823f.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003733108-01985605-002.pdf',
 'color': 'BLUE',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '280bb43a-4e12-593b-bbeb-807f0c52302f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'BK22WUY',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/PEUGEOT/3008?id=3733108',
 'listing': 'auction',
 'location': 'Manchester',
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 35255,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 46,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_280bb43a-4e12-593b-bbeb-807f0c52302f/280bb43a-4e12-593b-bbeb-807f0c52302f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 185319,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c417bd0e-e9ad-4d21-9c97-d90052b22054_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_280bb43a-4e12-593b-bbeb-807f0c52302f/280bb43a-4e12-593b-bbeb-807f0c52302f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 185319,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c417bd0e-e9ad-4d21-9c97-d90052b22054_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_280bb43a-4e12-593b-bbeb-807f0c52302f/280bb43a-4e12-593b-bbeb-807f0c52302f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 252883,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c417bd0e-e9ad-4d21-9c97-d90052b22054_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_280bb43a-4e12-593b-bbeb-807f0c52302f/280bb43a-4e12-593b-bbeb-807f0c52302f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 159691,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c417bd0e-e9ad-4d21-9c97-d90052b22054_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_280bb43a-4e12-593b-bbeb-807f0c52302f/280bb43a-4e12-593b-bbeb-807f0c52302f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 192315,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c417bd0e-e9ad-4d21-9c97-d90052b22054_5.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_280bb43a-4e12-593b-bbeb-807f0c52302f/280bb43a-4e12-593b-bbeb-807f0c52302f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 189746,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c417bd0e-e9ad-4d21-9c97-d90052b22054_4.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_280bb43a-4e12-593b-bbeb-807f0c52302f/280bb43a-4e12-593b-bbeb-807f0c52302f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 187420,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c417bd0e-e9ad-4d21-9c97-d90052b22054_11.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_280bb43a-4e12-593b-bbeb-807f0c52302f/280bb43a-4e12-593b-bbeb-807f0c52302f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 185454,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c417bd0e-e9ad-4d21-9c97-d90052b22054_10.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_280bb43a-4e12-593b-bbeb-807f0c52302f/280bb43a-4e12-593b-bbeb-807f0c52302f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 187579,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c417bd0e-e9ad-4d21-9c97-d90052b22054_9.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_280bb43a-4e12-593b-bbeb-807f0c52302f/280bb43a-4e12-593b-bbeb-807f0c52302f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 259996,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c417bd0e-e9ad-4d21-9c97-d90052b22054_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_280bb43a-4e12-593b-bbeb-807f0c52302f/280bb43a-4e12-593b-bbeb-807f0c52302f_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 190293,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c417bd0e-e9ad-4d21-9c97-d90052b22054_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_280bb43a-4e12-593b-bbeb-807f0c52302f/280bb43a-4e12-593b-bbeb-807f0c52302f_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 208519,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c417bd0e-e9ad-4d21-9c97-d90052b22054_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_280bb43a-4e12-593b-bbeb-807f0c52302f/280bb43a-4e12-593b-bbeb-807f0c52302f_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 302983,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c417bd0e-e9ad-4d21-9c97-d90052b22054_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_280bb43a-4e12-593b-bbeb-807f0c52302f/280bb43a-4e12-593b-bbeb-807f0c52302f_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 428198,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3733108-3998908-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_280bb43a-4e12-593b-bbeb-807f0c52302f/280bb43a-4e12-593b-bbeb-807f0c52302f_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 253072,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3733108-3998908-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_280bb43a-4e12-593b-bbeb-807f0c52302f/280bb43a-4e12-593b-bbeb-807f0c52302f_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 228298,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3733108-3998908-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_280bb43a-4e12-593b-bbeb-807f0c52302f/280bb43a-4e12-593b-bbeb-807f0c52302f_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 240931,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3733108-3998908-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_280bb43a-4e12-593b-bbeb-807f0c52302f/280bb43a-4e12-593b-bbeb-807f0c52302f_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 284295,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3733108-3998908-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_280bb43a-4e12-593b-bbeb-807f0c52302f/280bb43a-4e12-593b-bbeb-807f0c52302f_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 570739,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3733108-3998908-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_280bb43a-4e12-593b-bbeb-807f0c52302f/280bb43a-4e12-593b-bbeb-807f0c52302f_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 308704,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3733108-3998908-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-31',
 'seller_name': 'Santander Consumer',
 'title': 'PEUGEOT 3008 1.2 PureTech GT 5dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech GT 5dr',
 'year': 2022}
2025-12-04 10:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273733108%27 HTTP/1.1" 200 None
2025-12-04 10:06:30 [manheim.gb] INFO: Saving data for 3733108: {'created_time': 1764842790.616282, 'last_price_update_time': 1764842790.61629, 'auction_closing_time': 1764838800.0}
2025-12-04 10:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3733108') HTTP/1.1" 204 0
2025-12-04 10:06:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccfd2e10>
2025-12-04 10:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d41ca17-91a5-5695-a2ce-4ac7d4eea455/9d41ca17-91a5-5695-a2ce-4ac7d4eea455_image_3.jpg HTTP/1.1" 201 0
2025-12-04 10:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F45c612c5-7ee9-412e-8fcd-cca7a96ef77a_ext_1.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/45c612c5-7ee9-412e-8fcd-cca7a96ef77a_ext_1.jpg saved to cache
2025-12-04 10:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9d41ca17-91a5-5695-a2ce-4ac7d4eea455
2025-12-04 10:06:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cccd9650>
2025-12-04 10:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:06:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_672a8c4f-71d8-58f3-8299-077e7dbd1660/672a8c4f-71d8-58f3-8299-077e7dbd1660_image_0.jpg HTTP/1.1" 201 0
2025-12-04 10:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb0655140-7456-48b9-aa0e-6638426c5791_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b0655140-7456-48b9-aa0e-6638426c5791_ext_7.jpg saved to cache
2025-12-04 10:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 672a8c4f-71d8-58f3-8299-077e7dbd1660
2025-12-04 10:06:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 672a8c4f-71d8-58f3-8299-077e7dbd1660, skipping ID generation
2025-12-04 10:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 672a8c4f-71d8-58f3-8299-077e7dbd1660 from tracking dictionaries
2025-12-04 10:06:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 672a8c4f-71d8-58f3-8299-077e7dbd1660 sending to next pipeline
2025-12-04 10:06:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 672a8c4f-71d8-58f3-8299-077e7dbd1660, identifier: 3753028
2025-12-04 10:06:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ce6177d0>
2025-12-04 10:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:06:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd47cf9a-b495-54ed-94b9-5ff59695697b/cd47cf9a-b495-54ed-94b9-5ff59695697b_image_1.jpg HTTP/1.1" 201 0
2025-12-04 10:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F221af4c0-de76-4df7-a700-c6c79e40e8c7_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/221af4c0-de76-4df7-a700-c6c79e40e8c7_ext_7.jpg saved to cache
2025-12-04 10:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cd47cf9a-b495-54ed-94b9-5ff59695697b
2025-12-04 10:06:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd045690>
2025-12-04 10:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:06:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd47cf9a-b495-54ed-94b9-5ff59695697b/cd47cf9a-b495-54ed-94b9-5ff59695697b_image_0.jpg HTTP/1.1" 201 0
2025-12-04 10:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F221af4c0-de76-4df7-a700-c6c79e40e8c7_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/221af4c0-de76-4df7-a700-c6c79e40e8c7_ext_7.jpg saved to cache
2025-12-04 10:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cd47cf9a-b495-54ed-94b9-5ff59695697b
2025-12-04 10:06:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cd47cf9a-b495-54ed-94b9-5ff59695697b, skipping ID generation
2025-12-04 10:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Removing item cd47cf9a-b495-54ed-94b9-5ff59695697b from tracking dictionaries
2025-12-04 10:06:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cd47cf9a-b495-54ed-94b9-5ff59695697b sending to next pipeline
2025-12-04 10:06:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: cd47cf9a-b495-54ed-94b9-5ff59695697b, identifier: 3733236
2025-12-04 10:06:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 672a8c4f-71d8-58f3-8299-077e7dbd1660 with identifier: 3753028
2025-12-04 10:06:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 672a8c4f-71d8-58f3-8299-077e7dbd1660 with identifier: 3753028
2025-12-04 10:06:32 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 672a8c4f-71d8-58f3-8299-077e7dbd1660 with identifier: 3753028 to the API
2025-12-04 10:06:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 10:06:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 10:06:32 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/b0655140-7456-48b9-aa0e-6638426c5791_ext_7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_672a8c4f-71d8-58f3-8299-077e7dbd1660/672a8c4f-71d8-58f3-8299-077e7dbd1660_expert_report_file_8ae9073a-809e-402a-b0ff-8d1a35a04607.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003753028-01726675-006.pdf',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '672a8c4f-71d8-58f3-8299-077e7dbd1660',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'HN18NYM',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/KIA/SPORTAGE?id=3753028',
 'listing': 'auction',
 'location': 'Bristol',
 'make': 'KIA',
 'model': 'SPORTAGE',
 'odometer': 62725,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 40,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_672a8c4f-71d8-58f3-8299-077e7dbd1660/672a8c4f-71d8-58f3-8299-077e7dbd1660_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 146258,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b0655140-7456-48b9-aa0e-6638426c5791_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_672a8c4f-71d8-58f3-8299-077e7dbd1660/672a8c4f-71d8-58f3-8299-077e7dbd1660_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 146258,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b0655140-7456-48b9-aa0e-6638426c5791_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_672a8c4f-71d8-58f3-8299-077e7dbd1660/672a8c4f-71d8-58f3-8299-077e7dbd1660_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 252503,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b0655140-7456-48b9-aa0e-6638426c5791_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_672a8c4f-71d8-58f3-8299-077e7dbd1660/672a8c4f-71d8-58f3-8299-077e7dbd1660_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 193770,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b0655140-7456-48b9-aa0e-6638426c5791_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_672a8c4f-71d8-58f3-8299-077e7dbd1660/672a8c4f-71d8-58f3-8299-077e7dbd1660_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 135455,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b0655140-7456-48b9-aa0e-6638426c5791_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_672a8c4f-71d8-58f3-8299-077e7dbd1660/672a8c4f-71d8-58f3-8299-077e7dbd1660_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 129433,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b0655140-7456-48b9-aa0e-6638426c5791_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_672a8c4f-71d8-58f3-8299-077e7dbd1660/672a8c4f-71d8-58f3-8299-077e7dbd1660_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 139299,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b0655140-7456-48b9-aa0e-6638426c5791_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_672a8c4f-71d8-58f3-8299-077e7dbd1660/672a8c4f-71d8-58f3-8299-077e7dbd1660_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 126764,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b0655140-7456-48b9-aa0e-6638426c5791_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_672a8c4f-71d8-58f3-8299-077e7dbd1660/672a8c4f-71d8-58f3-8299-077e7dbd1660_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 143332,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b0655140-7456-48b9-aa0e-6638426c5791_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_672a8c4f-71d8-58f3-8299-077e7dbd1660/672a8c4f-71d8-58f3-8299-077e7dbd1660_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 280066,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b0655140-7456-48b9-aa0e-6638426c5791_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_672a8c4f-71d8-58f3-8299-077e7dbd1660/672a8c4f-71d8-58f3-8299-077e7dbd1660_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 238750,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b0655140-7456-48b9-aa0e-6638426c5791_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_672a8c4f-71d8-58f3-8299-077e7dbd1660/672a8c4f-71d8-58f3-8299-077e7dbd1660_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 212957,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b0655140-7456-48b9-aa0e-6638426c5791_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_672a8c4f-71d8-58f3-8299-077e7dbd1660/672a8c4f-71d8-58f3-8299-077e7dbd1660_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 223342,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b0655140-7456-48b9-aa0e-6638426c5791_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_672a8c4f-71d8-58f3-8299-077e7dbd1660/672a8c4f-71d8-58f3-8299-077e7dbd1660_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 311121,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3753028-3975419-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_672a8c4f-71d8-58f3-8299-077e7dbd1660/672a8c4f-71d8-58f3-8299-077e7dbd1660_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 356388,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3753028-3975419-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_672a8c4f-71d8-58f3-8299-077e7dbd1660/672a8c4f-71d8-58f3-8299-077e7dbd1660_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 510020,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3753028-3975419-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_672a8c4f-71d8-58f3-8299-077e7dbd1660/672a8c4f-71d8-58f3-8299-077e7dbd1660_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 363335,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3753028-3975419-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_672a8c4f-71d8-58f3-8299-077e7dbd1660/672a8c4f-71d8-58f3-8299-077e7dbd1660_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 390849,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3753028-3975419-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_672a8c4f-71d8-58f3-8299-077e7dbd1660/672a8c4f-71d8-58f3-8299-077e7dbd1660_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 309715,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3753028-3975419-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_672a8c4f-71d8-58f3-8299-077e7dbd1660/672a8c4f-71d8-58f3-8299-077e7dbd1660_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 315420,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3753028-3975419-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-06',
 'seller_name': 'MotoNovo Finance',
 'title': 'KIA SPORTAGE 1.6 GDi ISG 2 5dr',
 'transmission': 'manual',
 'trim': '1.6 GDi ISG 2 5dr',
 'year': 2018}
2025-12-04 10:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273753028%27 HTTP/1.1" 200 None
2025-12-04 10:06:32 [manheim.gb] INFO: Saving data for 3753028: {'created_time': 1764842792.501177, 'last_price_update_time': 1764842792.501189, 'auction_closing_time': 1765270800.0}
2025-12-04 10:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3753028') HTTP/1.1" 204 0
2025-12-04 10:06:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: cd47cf9a-b495-54ed-94b9-5ff59695697b with identifier: 3733236
2025-12-04 10:06:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-04 10:06:32 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Black HTTP/1.1" 200 None
2025-12-04 10:06:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-04 10:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-04 10:06:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: cd47cf9a-b495-54ed-94b9-5ff59695697b with identifier: 3733236
2025-12-04 10:06:32 [scrapy.core.scraper] INFO: Dropped: Dropping expired listing: cd47cf9a-b495-54ed-94b9-5ff59695697b with expiration date: 2025-12-04T09:00:00Z
{'auction_title': '',
 'c_o_2_emission_value': 98,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd47cf9a-b495-54ed-94b9-5ff59695697b/cd47cf9a-b495-54ed-94b9-5ff59695697b_expert_report_file_58c627bb-910c-4d9b-9e95-4000738169e7.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003733236-01988566-004.pdf',
 'color': 'Black',
 'currency': 'GBP',
 'engine': '1.5L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'cd47cf9a-b495-54ed-94b9-5ff59695697b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'LJ14WEO',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FORD/FIESTA?id=3733236',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'FORD',
 'model': 'FIESTA',
 'odometer': 126359,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 46,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd47cf9a-b495-54ed-94b9-5ff59695697b/cd47cf9a-b495-54ed-94b9-5ff59695697b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 245205,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/221af4c0-de76-4df7-a700-c6c79e40e8c7_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd47cf9a-b495-54ed-94b9-5ff59695697b/cd47cf9a-b495-54ed-94b9-5ff59695697b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 245205,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/221af4c0-de76-4df7-a700-c6c79e40e8c7_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd47cf9a-b495-54ed-94b9-5ff59695697b/cd47cf9a-b495-54ed-94b9-5ff59695697b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 226067,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/221af4c0-de76-4df7-a700-c6c79e40e8c7_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd47cf9a-b495-54ed-94b9-5ff59695697b/cd47cf9a-b495-54ed-94b9-5ff59695697b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 221159,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/221af4c0-de76-4df7-a700-c6c79e40e8c7_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd47cf9a-b495-54ed-94b9-5ff59695697b/cd47cf9a-b495-54ed-94b9-5ff59695697b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 184155,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/221af4c0-de76-4df7-a700-c6c79e40e8c7_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd47cf9a-b495-54ed-94b9-5ff59695697b/cd47cf9a-b495-54ed-94b9-5ff59695697b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 183932,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/221af4c0-de76-4df7-a700-c6c79e40e8c7_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd47cf9a-b495-54ed-94b9-5ff59695697b/cd47cf9a-b495-54ed-94b9-5ff59695697b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 181875,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/221af4c0-de76-4df7-a700-c6c79e40e8c7_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd47cf9a-b495-54ed-94b9-5ff59695697b/cd47cf9a-b495-54ed-94b9-5ff59695697b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 176222,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/221af4c0-de76-4df7-a700-c6c79e40e8c7_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd47cf9a-b495-54ed-94b9-5ff59695697b/cd47cf9a-b495-54ed-94b9-5ff59695697b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 178701,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/221af4c0-de76-4df7-a700-c6c79e40e8c7_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd47cf9a-b495-54ed-94b9-5ff59695697b/cd47cf9a-b495-54ed-94b9-5ff59695697b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 275842,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/221af4c0-de76-4df7-a700-c6c79e40e8c7_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd47cf9a-b495-54ed-94b9-5ff59695697b/cd47cf9a-b495-54ed-94b9-5ff59695697b_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 252792,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/221af4c0-de76-4df7-a700-c6c79e40e8c7_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd47cf9a-b495-54ed-94b9-5ff59695697b/cd47cf9a-b495-54ed-94b9-5ff59695697b_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 236001,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/221af4c0-de76-4df7-a700-c6c79e40e8c7_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd47cf9a-b495-54ed-94b9-5ff59695697b/cd47cf9a-b495-54ed-94b9-5ff59695697b_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 220007,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/221af4c0-de76-4df7-a700-c6c79e40e8c7_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd47cf9a-b495-54ed-94b9-5ff59695697b/cd47cf9a-b495-54ed-94b9-5ff59695697b_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 385964,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3733236-4004821-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd47cf9a-b495-54ed-94b9-5ff59695697b/cd47cf9a-b495-54ed-94b9-5ff59695697b_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 223888,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3733236-4004821-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd47cf9a-b495-54ed-94b9-5ff59695697b/cd47cf9a-b495-54ed-94b9-5ff59695697b_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 227290,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3733236-4004821-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd47cf9a-b495-54ed-94b9-5ff59695697b/cd47cf9a-b495-54ed-94b9-5ff59695697b_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 280016,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3733236-4004821-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd47cf9a-b495-54ed-94b9-5ff59695697b/cd47cf9a-b495-54ed-94b9-5ff59695697b_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 250049,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3733236-4004821-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd47cf9a-b495-54ed-94b9-5ff59695697b/cd47cf9a-b495-54ed-94b9-5ff59695697b_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 311508,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3733236-4004821-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd47cf9a-b495-54ed-94b9-5ff59695697b/cd47cf9a-b495-54ed-94b9-5ff59695697b_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 348049,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3733236-4004821-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-28',
 'seller_name': 'Big Motoring World Ltd',
 'title': 'FORD FIESTA 1.5 TDCi Titanium 5dr',
 'transmission': 'manual',
 'trim': '1.5 TDCi Titanium 5dr',
 'year': 2014}
2025-12-04 10:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273733236%27 HTTP/1.1" 200 None
2025-12-04 10:06:32 [manheim.gb] INFO: Saving data for 3733236: {'created_time': 1764842792.759853, 'last_price_update_time': 1764842792.759863, 'auction_closing_time': 1764838800.0}
2025-12-04 10:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3733236') HTTP/1.1" 204 0
2025-12-04 10:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/45c612c5-7ee9-412e-8fcd-cca7a96ef77a_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003732689-01709363-006.pdf)
2025-12-04 10:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/45c612c5-7ee9-412e-8fcd-cca7a96ef77a_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003732689-01709363-006.pdf)
2025-12-04 10:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/45c612c5-7ee9-412e-8fcd-cca7a96ef77a_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003732689-01709363-006.pdf)
2025-12-04 10:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3739898-4000232-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003739898-01981917-002.pdf)
2025-12-04 10:06:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccc9ff10>
2025-12-04 10:06:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d41ca17-91a5-5695-a2ce-4ac7d4eea455/9d41ca17-91a5-5695-a2ce-4ac7d4eea455_image_1.jpg HTTP/1.1" 201 0
2025-12-04 10:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F45c612c5-7ee9-412e-8fcd-cca7a96ef77a_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/45c612c5-7ee9-412e-8fcd-cca7a96ef77a_ext_7.jpg saved to cache
2025-12-04 10:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9d41ca17-91a5-5695-a2ce-4ac7d4eea455
2025-12-04 10:06:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cceff790>
2025-12-04 10:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d41ca17-91a5-5695-a2ce-4ac7d4eea455/9d41ca17-91a5-5695-a2ce-4ac7d4eea455_image_0.jpg HTTP/1.1" 201 0
2025-12-04 10:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F45c612c5-7ee9-412e-8fcd-cca7a96ef77a_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/45c612c5-7ee9-412e-8fcd-cca7a96ef77a_ext_7.jpg saved to cache
2025-12-04 10:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9d41ca17-91a5-5695-a2ce-4ac7d4eea455
2025-12-04 10:06:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd0f6e90>
2025-12-04 10:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 10:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d41ca17-91a5-5695-a2ce-4ac7d4eea455/9d41ca17-91a5-5695-a2ce-4ac7d4eea455_image_2.jpg HTTP/1.1" 201 0
2025-12-04 10:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F45c612c5-7ee9-412e-8fcd-cca7a96ef77a_ext_6.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/45c612c5-7ee9-412e-8fcd-cca7a96ef77a_ext_6.jpg saved to cache
2025-12-04 10:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9d41ca17-91a5-5695-a2ce-4ac7d4eea455
2025-12-04 10:06:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9d41ca17-91a5-5695-a2ce-4ac7d4eea455, skipping ID generation
2025-12-04 10:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 9d41ca17-91a5-5695-a2ce-4ac7d4eea455 from tracking dictionaries
2025-12-04 10:06:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9d41ca17-91a5-5695-a2ce-4ac7d4eea455 sending to next pipeline
2025-12-04 10:06:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 9d41ca17-91a5-5695-a2ce-4ac7d4eea455, identifier: 3732689
2025-12-04 10:06:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 9d41ca17-91a5-5695-a2ce-4ac7d4eea455 with identifier: 3732689
2025-12-04 10:06:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 9d41ca17-91a5-5695-a2ce-4ac7d4eea455 with identifier: 3732689
2025-12-04 10:06:33 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 9d41ca17-91a5-5695-a2ce-4ac7d4eea455 with identifier: 3732689 to the API
2025-12-04 10:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 10:06:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 10:06:34 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/45c612c5-7ee9-412e-8fcd-cca7a96ef77a_ext_6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d41ca17-91a5-5695-a2ce-4ac7d4eea455/9d41ca17-91a5-5695-a2ce-4ac7d4eea455_expert_report_file_2c93d5a1-cdb1-4e05-859c-0019e3fb07ef.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003732689-01709363-006.pdf',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '9d41ca17-91a5-5695-a2ce-4ac7d4eea455',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'WR18OGA',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=3732689',
 'listing': 'auction',
 'location': 'Shotts',
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 82558,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 43,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d41ca17-91a5-5695-a2ce-4ac7d4eea455/9d41ca17-91a5-5695-a2ce-4ac7d4eea455_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 248740,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/45c612c5-7ee9-412e-8fcd-cca7a96ef77a_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d41ca17-91a5-5695-a2ce-4ac7d4eea455/9d41ca17-91a5-5695-a2ce-4ac7d4eea455_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 248740,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/45c612c5-7ee9-412e-8fcd-cca7a96ef77a_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d41ca17-91a5-5695-a2ce-4ac7d4eea455/9d41ca17-91a5-5695-a2ce-4ac7d4eea455_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 246066,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/45c612c5-7ee9-412e-8fcd-cca7a96ef77a_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d41ca17-91a5-5695-a2ce-4ac7d4eea455/9d41ca17-91a5-5695-a2ce-4ac7d4eea455_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 190429,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/45c612c5-7ee9-412e-8fcd-cca7a96ef77a_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d41ca17-91a5-5695-a2ce-4ac7d4eea455/9d41ca17-91a5-5695-a2ce-4ac7d4eea455_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 256985,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/45c612c5-7ee9-412e-8fcd-cca7a96ef77a_5.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d41ca17-91a5-5695-a2ce-4ac7d4eea455/9d41ca17-91a5-5695-a2ce-4ac7d4eea455_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 238285,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/45c612c5-7ee9-412e-8fcd-cca7a96ef77a_4.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d41ca17-91a5-5695-a2ce-4ac7d4eea455/9d41ca17-91a5-5695-a2ce-4ac7d4eea455_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 258225,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/45c612c5-7ee9-412e-8fcd-cca7a96ef77a_11.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d41ca17-91a5-5695-a2ce-4ac7d4eea455/9d41ca17-91a5-5695-a2ce-4ac7d4eea455_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 240694,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/45c612c5-7ee9-412e-8fcd-cca7a96ef77a_10.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d41ca17-91a5-5695-a2ce-4ac7d4eea455/9d41ca17-91a5-5695-a2ce-4ac7d4eea455_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 252634,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/45c612c5-7ee9-412e-8fcd-cca7a96ef77a_9.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d41ca17-91a5-5695-a2ce-4ac7d4eea455/9d41ca17-91a5-5695-a2ce-4ac7d4eea455_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 228455,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/45c612c5-7ee9-412e-8fcd-cca7a96ef77a_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d41ca17-91a5-5695-a2ce-4ac7d4eea455/9d41ca17-91a5-5695-a2ce-4ac7d4eea455_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 222053,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/45c612c5-7ee9-412e-8fcd-cca7a96ef77a_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d41ca17-91a5-5695-a2ce-4ac7d4eea455/9d41ca17-91a5-5695-a2ce-4ac7d4eea455_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 237003,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/45c612c5-7ee9-412e-8fcd-cca7a96ef77a_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d41ca17-91a5-5695-a2ce-4ac7d4eea455/9d41ca17-91a5-5695-a2ce-4ac7d4eea455_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 193608,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/45c612c5-7ee9-412e-8fcd-cca7a96ef77a_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d41ca17-91a5-5695-a2ce-4ac7d4eea455/9d41ca17-91a5-5695-a2ce-4ac7d4eea455_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 354159,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3732689-4003546-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d41ca17-91a5-5695-a2ce-4ac7d4eea455/9d41ca17-91a5-5695-a2ce-4ac7d4eea455_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 309827,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3732689-4003546-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d41ca17-91a5-5695-a2ce-4ac7d4eea455/9d41ca17-91a5-5695-a2ce-4ac7d4eea455_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 167670,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3732689-4003546-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d41ca17-91a5-5695-a2ce-4ac7d4eea455/9d41ca17-91a5-5695-a2ce-4ac7d4eea455_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 282532,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3732689-4003546-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d41ca17-91a5-5695-a2ce-4ac7d4eea455/9d41ca17-91a5-5695-a2ce-4ac7d4eea455_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 340944,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3732689-4003546-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d41ca17-91a5-5695-a2ce-4ac7d4eea455/9d41ca17-91a5-5695-a2ce-4ac7d4eea455_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 310554,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3732689-4003546-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d41ca17-91a5-5695-a2ce-4ac7d4eea455/9d41ca17-91a5-5695-a2ce-4ac7d4eea455_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 250990,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3732689-4003546-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-30',
 'seller_name': 'MotoNovo Finance',
 'title': 'NISSAN QASHQAI 1.6 dCi Tekna+ 5dr',
 'transmission': 'manual',
 'trim': '1.6 dCi Tekna+ 5dr',
 'year': 2018}
2025-12-04 10:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273732689%27 HTTP/1.1" 200 None
2025-12-04 10:06:34 [manheim.gb] INFO: Saving data for 3732689: {'created_time': 1764842794.118766, 'last_price_update_time': 1764842794.118775, 'auction_closing_time': 1765270800.0}
2025-12-04 10:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3732689') HTTP/1.1" 204 0
2025-12-04 10:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3739898-4000232-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003739898-01981917-002.pdf)
2025-12-04 10:06:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc544110>
2025-12-04 10:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a78d527e-dc6e-518f-ad6e-20beb5b60643/a78d527e-dc6e-518f-ad6e-20beb5b60643_image_19.jpg HTTP/1.1" 201 0
2025-12-04 10:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3739898-4000232-1005.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3739898-4000232-1005.jpg saved to cache
2025-12-04 10:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item a78d527e-dc6e-518f-ad6e-20beb5b60643
2025-12-04 10:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003721892-01977567-004.pdf> (referer: None)
2025-12-04 10:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3739898-4000232-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003739898-01981917-002.pdf)
2025-12-04 10:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3739898-4000232-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003739898-01981917-002.pdf)
2025-12-04 10:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3739898-4000232-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003739898-01981917-002.pdf)
2025-12-04 10:06:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc69bd10>
2025-12-04 10:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 10:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a78d527e-dc6e-518f-ad6e-20beb5b60643/a78d527e-dc6e-518f-ad6e-20beb5b60643_image_18.jpg HTTP/1.1" 201 0
2025-12-04 10:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3739898-4000232-1004.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3739898-4000232-1004.jpg saved to cache
2025-12-04 10:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item a78d527e-dc6e-518f-ad6e-20beb5b60643
2025-12-04 10:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3739898-4000232-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003739898-01981917-002.pdf)
2025-12-04 10:06:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ce4e7050>
2025-12-04 10:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9eb786ba-30f6-5c6b-8f71-dcbf54908e30/9eb786ba-30f6-5c6b-8f71-dcbf54908e30_expert_report_file_3dc69c16-5986-43ca-9fbb-651a52d83f78.pdf HTTP/1.1" 201 0
2025-12-04 10:06:35 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 9eb786ba-30f6-5c6b-8f71-dcbf54908e30
2025-12-04 10:06:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9eb786ba-30f6-5c6b-8f71-dcbf54908e30, skipping ID generation
2025-12-04 10:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 9eb786ba-30f6-5c6b-8f71-dcbf54908e30
2025-12-04 10:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0ac78211-1e83-4c9a-8c90-e3278f7194f6_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0ac78211-1e83-4c9a-8c90-e3278f7194f6_ext_7.jpg already downloaded
2025-12-04 10:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0ac78211-1e83-4c9a-8c90-e3278f7194f6_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0ac78211-1e83-4c9a-8c90-e3278f7194f6_ext_7.jpg already downloaded
2025-12-04 10:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0ac78211-1e83-4c9a-8c90-e3278f7194f6_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0ac78211-1e83-4c9a-8c90-e3278f7194f6_ext_6.jpg already downloaded
2025-12-04 10:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0ac78211-1e83-4c9a-8c90-e3278f7194f6_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0ac78211-1e83-4c9a-8c90-e3278f7194f6_ext_1.jpg already downloaded
2025-12-04 10:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0ac78211-1e83-4c9a-8c90-e3278f7194f6_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0ac78211-1e83-4c9a-8c90-e3278f7194f6_5.jpg already downloaded
2025-12-04 10:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0ac78211-1e83-4c9a-8c90-e3278f7194f6_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0ac78211-1e83-4c9a-8c90-e3278f7194f6_4.jpg already downloaded
2025-12-04 10:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0ac78211-1e83-4c9a-8c90-e3278f7194f6_11.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0ac78211-1e83-4c9a-8c90-e3278f7194f6_11.jpg already downloaded
2025-12-04 10:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0ac78211-1e83-4c9a-8c90-e3278f7194f6_10.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0ac78211-1e83-4c9a-8c90-e3278f7194f6_10.jpg already downloaded
2025-12-04 10:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0ac78211-1e83-4c9a-8c90-e3278f7194f6_9.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0ac78211-1e83-4c9a-8c90-e3278f7194f6_9.jpg already downloaded
2025-12-04 10:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0ac78211-1e83-4c9a-8c90-e3278f7194f6_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0ac78211-1e83-4c9a-8c90-e3278f7194f6_ext_2.jpg already downloaded
2025-12-04 10:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0ac78211-1e83-4c9a-8c90-e3278f7194f6_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0ac78211-1e83-4c9a-8c90-e3278f7194f6_ext_5.jpg already downloaded
2025-12-04 10:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0ac78211-1e83-4c9a-8c90-e3278f7194f6_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0ac78211-1e83-4c9a-8c90-e3278f7194f6_ext_3.jpg already downloaded
2025-12-04 10:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0ac78211-1e83-4c9a-8c90-e3278f7194f6_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0ac78211-1e83-4c9a-8c90-e3278f7194f6_ext_4.jpg already downloaded
2025-12-04 10:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3721892-3990671-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3721892-3990671-13.jpg already downloaded
2025-12-04 10:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3721892-3990671-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3721892-3990671-1000.jpg already downloaded
2025-12-04 10:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3721892-3990671-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3721892-3990671-1001.jpg already downloaded
2025-12-04 10:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3721892-3990671-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3721892-3990671-1002.jpg already downloaded
2025-12-04 10:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3721892-3990671-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3721892-3990671-1003.jpg already downloaded
2025-12-04 10:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3721892-3990671-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3721892-3990671-1004.jpg already downloaded
2025-12-04 10:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3721892-3990671-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3721892-3990671-1005.jpg already downloaded
2025-12-04 10:06:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 9eb786ba-30f6-5c6b-8f71-dcbf54908e30, identifier: 3721892
2025-12-04 10:06:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce642d0>
2025-12-04 10:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:06:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a78d527e-dc6e-518f-ad6e-20beb5b60643/a78d527e-dc6e-518f-ad6e-20beb5b60643_image_17.jpg HTTP/1.1" 201 0
2025-12-04 10:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3739898-4000232-1003.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3739898-4000232-1003.jpg saved to cache
2025-12-04 10:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item a78d527e-dc6e-518f-ad6e-20beb5b60643
2025-12-04 10:06:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc650190>
2025-12-04 10:06:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:06:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a78d527e-dc6e-518f-ad6e-20beb5b60643/a78d527e-dc6e-518f-ad6e-20beb5b60643_image_16.jpg HTTP/1.1" 201 0
2025-12-04 10:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3739898-4000232-1002.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3739898-4000232-1002.jpg saved to cache
2025-12-04 10:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item a78d527e-dc6e-518f-ad6e-20beb5b60643
2025-12-04 10:06:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccfe09d0>
2025-12-04 10:06:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:06:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a78d527e-dc6e-518f-ad6e-20beb5b60643/a78d527e-dc6e-518f-ad6e-20beb5b60643_image_15.jpg HTTP/1.1" 201 0
2025-12-04 10:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3739898-4000232-1001.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3739898-4000232-1001.jpg saved to cache
2025-12-04 10:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item a78d527e-dc6e-518f-ad6e-20beb5b60643
2025-12-04 10:06:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 9eb786ba-30f6-5c6b-8f71-dcbf54908e30 with identifier: 3721892
2025-12-04 10:06:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 9eb786ba-30f6-5c6b-8f71-dcbf54908e30 with identifier: 3721892
2025-12-04 10:06:36 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 9eb786ba-30f6-5c6b-8f71-dcbf54908e30 with identifier: 3721892 to the API
2025-12-04 10:06:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 10:06:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 10:06:37 [scrapy.core.scraper] DEBUG: Scraped from <200 http://ecr.manheim.co.uk/pdf/MOL-0003721892-01977567-004.pdf>
{'auction_title': '',
 'c_o_2_emission_value': 145,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9eb786ba-30f6-5c6b-8f71-dcbf54908e30/9eb786ba-30f6-5c6b-8f71-dcbf54908e30_expert_report_file_3dc69c16-5986-43ca-9fbb-651a52d83f78.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003721892-01977567-004.pdf',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '1.3L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '9eb786ba-30f6-5c6b-8f71-dcbf54908e30',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'YA70WEJ',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=3721892',
 'listing': 'auction',
 'location': 'Bristol',
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 39997,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 35,
 'photo_urls': ['http://images.manheim.co.uk/images/units/zoom/0ac78211-1e83-4c9a-8c90-e3278f7194f6_ext_7.jpg',
                'http://images.manheim.co.uk/images/units/zoom/0ac78211-1e83-4c9a-8c90-e3278f7194f6_ext_7.jpg',
                'http://images.manheim.co.uk/images/units/zoom/0ac78211-1e83-4c9a-8c90-e3278f7194f6_ext_6.jpg',
                'http://images.manheim.co.uk/images/units/zoom/0ac78211-1e83-4c9a-8c90-e3278f7194f6_ext_1.jpg',
                'http://images.manheim.co.uk/images/units/zoom/0ac78211-1e83-4c9a-8c90-e3278f7194f6_5.jpg',
                'http://images.manheim.co.uk/images/units/zoom/0ac78211-1e83-4c9a-8c90-e3278f7194f6_4.jpg',
                'http://images.manheim.co.uk/images/units/zoom/0ac78211-1e83-4c9a-8c90-e3278f7194f6_11.jpg',
                'http://images.manheim.co.uk/images/units/zoom/0ac78211-1e83-4c9a-8c90-e3278f7194f6_10.jpg',
                'http://images.manheim.co.uk/images/units/zoom/0ac78211-1e83-4c9a-8c90-e3278f7194f6_9.jpg',
                'http://images.manheim.co.uk/images/units/zoom/0ac78211-1e83-4c9a-8c90-e3278f7194f6_ext_2.jpg',
                'http://images.manheim.co.uk/images/units/zoom/0ac78211-1e83-4c9a-8c90-e3278f7194f6_ext_5.jpg',
                'http://images.manheim.co.uk/images/units/zoom/0ac78211-1e83-4c9a-8c90-e3278f7194f6_ext_3.jpg',
                'http://images.manheim.co.uk/images/units/zoom/0ac78211-1e83-4c9a-8c90-e3278f7194f6_ext_4.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3721892-3990671-13.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3721892-3990671-1000.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3721892-3990671-1001.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3721892-3990671-1002.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3721892-3990671-1003.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3721892-3990671-1004.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3721892-3990671-1005.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9eb786ba-30f6-5c6b-8f71-dcbf54908e30/9eb786ba-30f6-5c6b-8f71-dcbf54908e30_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98014,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0ac78211-1e83-4c9a-8c90-e3278f7194f6_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9eb786ba-30f6-5c6b-8f71-dcbf54908e30/9eb786ba-30f6-5c6b-8f71-dcbf54908e30_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98014,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0ac78211-1e83-4c9a-8c90-e3278f7194f6_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9eb786ba-30f6-5c6b-8f71-dcbf54908e30/9eb786ba-30f6-5c6b-8f71-dcbf54908e30_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 245397,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0ac78211-1e83-4c9a-8c90-e3278f7194f6_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9eb786ba-30f6-5c6b-8f71-dcbf54908e30/9eb786ba-30f6-5c6b-8f71-dcbf54908e30_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 172988,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0ac78211-1e83-4c9a-8c90-e3278f7194f6_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9eb786ba-30f6-5c6b-8f71-dcbf54908e30/9eb786ba-30f6-5c6b-8f71-dcbf54908e30_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93897,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0ac78211-1e83-4c9a-8c90-e3278f7194f6_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9eb786ba-30f6-5c6b-8f71-dcbf54908e30/9eb786ba-30f6-5c6b-8f71-dcbf54908e30_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92442,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0ac78211-1e83-4c9a-8c90-e3278f7194f6_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9eb786ba-30f6-5c6b-8f71-dcbf54908e30/9eb786ba-30f6-5c6b-8f71-dcbf54908e30_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92417,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0ac78211-1e83-4c9a-8c90-e3278f7194f6_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9eb786ba-30f6-5c6b-8f71-dcbf54908e30/9eb786ba-30f6-5c6b-8f71-dcbf54908e30_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90368,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0ac78211-1e83-4c9a-8c90-e3278f7194f6_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9eb786ba-30f6-5c6b-8f71-dcbf54908e30/9eb786ba-30f6-5c6b-8f71-dcbf54908e30_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90571,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0ac78211-1e83-4c9a-8c90-e3278f7194f6_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9eb786ba-30f6-5c6b-8f71-dcbf54908e30/9eb786ba-30f6-5c6b-8f71-dcbf54908e30_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 210347,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0ac78211-1e83-4c9a-8c90-e3278f7194f6_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9eb786ba-30f6-5c6b-8f71-dcbf54908e30/9eb786ba-30f6-5c6b-8f71-dcbf54908e30_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 217259,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0ac78211-1e83-4c9a-8c90-e3278f7194f6_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9eb786ba-30f6-5c6b-8f71-dcbf54908e30/9eb786ba-30f6-5c6b-8f71-dcbf54908e30_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 182112,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0ac78211-1e83-4c9a-8c90-e3278f7194f6_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9eb786ba-30f6-5c6b-8f71-dcbf54908e30/9eb786ba-30f6-5c6b-8f71-dcbf54908e30_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 191044,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0ac78211-1e83-4c9a-8c90-e3278f7194f6_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9eb786ba-30f6-5c6b-8f71-dcbf54908e30/9eb786ba-30f6-5c6b-8f71-dcbf54908e30_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 342825,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3721892-3990671-13.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9eb786ba-30f6-5c6b-8f71-dcbf54908e30/9eb786ba-30f6-5c6b-8f71-dcbf54908e30_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 356051,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3721892-3990671-1000.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9eb786ba-30f6-5c6b-8f71-dcbf54908e30/9eb786ba-30f6-5c6b-8f71-dcbf54908e30_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 326179,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3721892-3990671-1001.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9eb786ba-30f6-5c6b-8f71-dcbf54908e30/9eb786ba-30f6-5c6b-8f71-dcbf54908e30_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 294842,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3721892-3990671-1002.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9eb786ba-30f6-5c6b-8f71-dcbf54908e30/9eb786ba-30f6-5c6b-8f71-dcbf54908e30_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 261080,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3721892-3990671-1003.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9eb786ba-30f6-5c6b-8f71-dcbf54908e30/9eb786ba-30f6-5c6b-8f71-dcbf54908e30_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 198630,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3721892-3990671-1004.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9eb786ba-30f6-5c6b-8f71-dcbf54908e30/9eb786ba-30f6-5c6b-8f71-dcbf54908e30_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 292045,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3721892-3990671-1005.jpg',
             'Width': 1500}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-31',
 'seller_name': 'Mobilize Financial Services',
 'title': 'NISSAN QASHQAI 1.3 DiG-T N-Connecta 5dr [Glass Roof Pack]',
 'transmission': 'manual',
 'trim': '1.3 DiG-T N-Connecta 5dr [Glass Roof Pack]',
 'year': 2020}
2025-12-04 10:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273721892%27 HTTP/1.1" 200 None
2025-12-04 10:06:37 [manheim.gb] INFO: Saving data for 3721892: {'created_time': 1764842797.152527, 'last_price_update_time': 1764842797.152539, 'auction_closing_time': 1765270800.0}
2025-12-04 10:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3721892') HTTP/1.1" 204 0
2025-12-04 10:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VAUXHALL/CORSA?id=3708538&returnUrl=%2Fsearch%3FPage%3D4%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233708538&indx=350> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 10:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/GOLF?id=3696571&returnUrl=%2Fsearch%3FPage%3D4%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233696571&indx=348> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 10:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/LAND%20ROVER/DISCOVERYSPORT?id=3696200&returnUrl=%2Fsearch%3FPage%3D4%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233696200&indx=346> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 10:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/MG/MG3?id=3695980&returnUrl=%2Fsearch%3FPage%3D4%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233695980&indx=345> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 10:06:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 10:06:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 10:06:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 10:06:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccefde50>
2025-12-04 10:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 10:06:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a78d527e-dc6e-518f-ad6e-20beb5b60643/a78d527e-dc6e-518f-ad6e-20beb5b60643_image_14.jpg HTTP/1.1" 201 0
2025-12-04 10:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3739898-4000232-1000.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3739898-4000232-1000.jpg saved to cache
2025-12-04 10:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item a78d527e-dc6e-518f-ad6e-20beb5b60643
2025-12-04 10:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/59096750-d732-4a04-93b4-5b26681153f6_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003739898-01981917-002.pdf)
2025-12-04 10:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/59096750-d732-4a04-93b4-5b26681153f6_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003739898-01981917-002.pdf)
2025-12-04 10:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/59096750-d732-4a04-93b4-5b26681153f6_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003739898-01981917-002.pdf)
2025-12-04 10:06:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9dd73959-96d3-5565-aaaa-e6a65d9ad4ab with identifier: 3708538
2025-12-04 10:06:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9dd73959-96d3-5565-aaaa-e6a65d9ad4ab with scrape type 1
2025-12-04 10:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 9dd73959-96d3-5565-aaaa-e6a65d9ad4ab
2025-12-04 10:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3708538-3688559-1.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3708538-3688559-1.jpg not downloaded yet
2025-12-04 10:06:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3bb83e1f-59e6-5bec-b8e0-b3e9161a4c7a with identifier: 3696571
2025-12-04 10:06:37 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 3bb83e1f-59e6-5bec-b8e0-b3e9161a4c7a
2025-12-04 10:06:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b81e6d8-b03c-5a08-b62b-f3cfc1b0bb9f with identifier: 3696200
2025-12-04 10:06:37 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 1b81e6d8-b03c-5a08-b62b-f3cfc1b0bb9f
2025-12-04 10:06:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53095d01-1a66-5767-9416-77f431c3c7f5 with identifier: 3695980
2025-12-04 10:06:37 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 53095d01-1a66-5767-9416-77f431c3c7f5
2025-12-04 10:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/59096750-d732-4a04-93b4-5b26681153f6_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003739898-01981917-002.pdf)
2025-12-04 10:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3739898-4000232-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003739898-01981917-002.pdf)
2025-12-04 10:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3708538-3688559-2.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3708538-3688559-2.jpg not downloaded yet
2025-12-04 10:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3708538-3688559-3.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3708538-3688559-3.jpg not downloaded yet
2025-12-04 10:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3708538-3688559-4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3708538-3688559-4.jpg not downloaded yet
2025-12-04 10:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3708538-3688559-6.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3708538-3688559-6.jpg not downloaded yet
2025-12-04 10:06:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc57b550>
2025-12-04 10:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:06:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a78d527e-dc6e-518f-ad6e-20beb5b60643/a78d527e-dc6e-518f-ad6e-20beb5b60643_image_12.jpg HTTP/1.1" 201 0
2025-12-04 10:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F59096750-d732-4a04-93b4-5b26681153f6_ext_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/59096750-d732-4a04-93b4-5b26681153f6_ext_4.jpg saved to cache
2025-12-04 10:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item a78d527e-dc6e-518f-ad6e-20beb5b60643
2025-12-04 10:06:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ce707bd0>
2025-12-04 10:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:06:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a78d527e-dc6e-518f-ad6e-20beb5b60643/a78d527e-dc6e-518f-ad6e-20beb5b60643_image_10.jpg HTTP/1.1" 201 0
2025-12-04 10:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F59096750-d732-4a04-93b4-5b26681153f6_ext_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/59096750-d732-4a04-93b4-5b26681153f6_ext_5.jpg saved to cache
2025-12-04 10:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item a78d527e-dc6e-518f-ad6e-20beb5b60643
2025-12-04 10:06:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccc830d0>
2025-12-04 10:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 10:06:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a78d527e-dc6e-518f-ad6e-20beb5b60643/a78d527e-dc6e-518f-ad6e-20beb5b60643_image_11.jpg HTTP/1.1" 201 0
2025-12-04 10:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F59096750-d732-4a04-93b4-5b26681153f6_ext_3.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/59096750-d732-4a04-93b4-5b26681153f6_ext_3.jpg saved to cache
2025-12-04 10:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item a78d527e-dc6e-518f-ad6e-20beb5b60643
2025-12-04 10:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3708538-3688559-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3708538-3688559-13.jpg not downloaded yet
2025-12-04 10:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/59096750-d732-4a04-93b4-5b26681153f6_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003739898-01981917-002.pdf)
2025-12-04 10:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/59096750-d732-4a04-93b4-5b26681153f6_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003739898-01981917-002.pdf)
2025-12-04 10:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/59096750-d732-4a04-93b4-5b26681153f6_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003739898-01981917-002.pdf)
2025-12-04 10:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/59096750-d732-4a04-93b4-5b26681153f6_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003739898-01981917-002.pdf)
2025-12-04 10:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/59096750-d732-4a04-93b4-5b26681153f6_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003739898-01981917-002.pdf)
2025-12-04 10:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/59096750-d732-4a04-93b4-5b26681153f6_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003739898-01981917-002.pdf)
2025-12-04 10:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3708538-3688559-8.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3708538-3688559-8.jpg not downloaded yet
2025-12-04 10:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/59096750-d732-4a04-93b4-5b26681153f6_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003739898-01981917-002.pdf)
2025-12-04 10:06:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cced9390>
2025-12-04 10:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:06:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a78d527e-dc6e-518f-ad6e-20beb5b60643/a78d527e-dc6e-518f-ad6e-20beb5b60643_image_9.jpg HTTP/1.1" 201 0
2025-12-04 10:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F59096750-d732-4a04-93b4-5b26681153f6_ext_2.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/59096750-d732-4a04-93b4-5b26681153f6_ext_2.jpg saved to cache
2025-12-04 10:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a78d527e-dc6e-518f-ad6e-20beb5b60643
2025-12-04 10:06:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf9dcd0>
2025-12-04 10:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:06:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a78d527e-dc6e-518f-ad6e-20beb5b60643/a78d527e-dc6e-518f-ad6e-20beb5b60643_image_13.jpg HTTP/1.1" 201 0
2025-12-04 10:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3739898-4000232-13.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3739898-4000232-13.jpg saved to cache
2025-12-04 10:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item a78d527e-dc6e-518f-ad6e-20beb5b60643
2025-12-04 10:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3708538-3688559-16.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3708538-3688559-16.jpg not downloaded yet
2025-12-04 10:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/KIA/SORENTO?id=3696287&returnUrl=%2Fsearch%3FPage%3D4%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233696287&indx=347> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 10:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3708538-3688559-28.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3708538-3688559-28.jpg not downloaded yet
2025-12-04 10:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3708538-3688559-42.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3708538-3688559-42.jpg not downloaded yet
2025-12-04 10:06:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5992d0>
2025-12-04 10:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:06:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a78d527e-dc6e-518f-ad6e-20beb5b60643/a78d527e-dc6e-518f-ad6e-20beb5b60643_image_6.jpg HTTP/1.1" 201 0
2025-12-04 10:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F59096750-d732-4a04-93b4-5b26681153f6_11.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/59096750-d732-4a04-93b4-5b26681153f6_11.jpg saved to cache
2025-12-04 10:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a78d527e-dc6e-518f-ad6e-20beb5b60643
2025-12-04 10:06:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce2c650>
2025-12-04 10:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:06:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a78d527e-dc6e-518f-ad6e-20beb5b60643/a78d527e-dc6e-518f-ad6e-20beb5b60643_image_7.jpg HTTP/1.1" 201 0
2025-12-04 10:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F59096750-d732-4a04-93b4-5b26681153f6_10.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/59096750-d732-4a04-93b4-5b26681153f6_10.jpg saved to cache
2025-12-04 10:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a78d527e-dc6e-518f-ad6e-20beb5b60643
2025-12-04 10:06:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ce438fd0>
2025-12-04 10:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a78d527e-dc6e-518f-ad6e-20beb5b60643/a78d527e-dc6e-518f-ad6e-20beb5b60643_image_8.jpg HTTP/1.1" 201 0
2025-12-04 10:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F59096750-d732-4a04-93b4-5b26681153f6_9.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/59096750-d732-4a04-93b4-5b26681153f6_9.jpg saved to cache
2025-12-04 10:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a78d527e-dc6e-518f-ad6e-20beb5b60643
2025-12-04 10:06:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce2f7d0>
2025-12-04 10:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a78d527e-dc6e-518f-ad6e-20beb5b60643/a78d527e-dc6e-518f-ad6e-20beb5b60643_image_4.jpg HTTP/1.1" 201 0
2025-12-04 10:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F59096750-d732-4a04-93b4-5b26681153f6_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/59096750-d732-4a04-93b4-5b26681153f6_5.jpg saved to cache
2025-12-04 10:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a78d527e-dc6e-518f-ad6e-20beb5b60643
2025-12-04 10:06:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccffced0>
2025-12-04 10:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a78d527e-dc6e-518f-ad6e-20beb5b60643/a78d527e-dc6e-518f-ad6e-20beb5b60643_image_5.jpg HTTP/1.1" 201 0
2025-12-04 10:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F59096750-d732-4a04-93b4-5b26681153f6_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/59096750-d732-4a04-93b4-5b26681153f6_4.jpg saved to cache
2025-12-04 10:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a78d527e-dc6e-518f-ad6e-20beb5b60643
2025-12-04 10:06:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cccc7090>
2025-12-04 10:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a78d527e-dc6e-518f-ad6e-20beb5b60643/a78d527e-dc6e-518f-ad6e-20beb5b60643_image_3.jpg HTTP/1.1" 201 0
2025-12-04 10:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F59096750-d732-4a04-93b4-5b26681153f6_ext_1.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/59096750-d732-4a04-93b4-5b26681153f6_ext_1.jpg saved to cache
2025-12-04 10:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a78d527e-dc6e-518f-ad6e-20beb5b60643
2025-12-04 10:06:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6481d0>
2025-12-04 10:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:06:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a78d527e-dc6e-518f-ad6e-20beb5b60643/a78d527e-dc6e-518f-ad6e-20beb5b60643_image_2.jpg HTTP/1.1" 201 0
2025-12-04 10:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F59096750-d732-4a04-93b4-5b26681153f6_ext_6.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/59096750-d732-4a04-93b4-5b26681153f6_ext_6.jpg saved to cache
2025-12-04 10:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a78d527e-dc6e-518f-ad6e-20beb5b60643
2025-12-04 10:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3708538-3688559-43.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3708538-3688559-43.jpg not downloaded yet
2025-12-04 10:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3708538-3688559-44.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3708538-3688559-44.jpg not downloaded yet
2025-12-04 10:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3708538-3688559-3.jpg> (referer: None)
2025-12-04 10:06:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f085d439-0f07-522a-b6ab-a69d48fc5f61 with identifier: 3696287
2025-12-04 10:06:41 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item f085d439-0f07-522a-b6ab-a69d48fc5f61
2025-12-04 10:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3708538-3688559-2.jpg> (referer: None)
2025-12-04 10:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3708538-3688559-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3708538-3688559-1000.jpg not downloaded yet
2025-12-04 10:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3708538-3688559-4.jpg> (referer: None)
2025-12-04 10:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3708538-3688559-16.jpg> (referer: None)
2025-12-04 10:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3708538-3688559-13.jpg> (referer: None)
2025-12-04 10:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3708538-3688559-1.jpg> (referer: None)
2025-12-04 10:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3708538-3688559-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3708538-3688559-1001.jpg not downloaded yet
2025-12-04 10:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3708538-3688559-6.jpg> (referer: None)
2025-12-04 10:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3708538-3688559-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3708538-3688559-1002.jpg not downloaded yet
2025-12-04 10:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3708538-3688559-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3708538-3688559-1003.jpg not downloaded yet
2025-12-04 10:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003696200-01975592-008.pdf> (referer: None)
2025-12-04 10:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3708538-3688559-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3708538-3688559-1004.jpg not downloaded yet
2025-12-04 10:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3708538-3688559-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3708538-3688559-1005.jpg not downloaded yet
2025-12-04 10:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003696571-01983522-003.pdf> (referer: None)
2025-12-04 10:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3708538-3688559-1006.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3708538-3688559-1006.jpg not downloaded yet
2025-12-04 10:06:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd558d0>
2025-12-04 10:06:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:06:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dd73959-96d3-5565-aaaa-e6a65d9ad4ab/9dd73959-96d3-5565-aaaa-e6a65d9ad4ab_image_2.jpg HTTP/1.1" 201 0
2025-12-04 10:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3708538-3688559-3.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3708538-3688559-3.jpg saved to cache
2025-12-04 10:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9dd73959-96d3-5565-aaaa-e6a65d9ad4ab
2025-12-04 10:06:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf16610>
2025-12-04 10:06:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:06:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dd73959-96d3-5565-aaaa-e6a65d9ad4ab/9dd73959-96d3-5565-aaaa-e6a65d9ad4ab_image_1.jpg HTTP/1.1" 201 0
2025-12-04 10:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3708538-3688559-2.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3708538-3688559-2.jpg saved to cache
2025-12-04 10:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9dd73959-96d3-5565-aaaa-e6a65d9ad4ab
2025-12-04 10:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3708538-3688559-1007.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3708538-3688559-1007.jpg not downloaded yet
2025-12-04 10:06:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6c44d0>
2025-12-04 10:06:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:06:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dd73959-96d3-5565-aaaa-e6a65d9ad4ab/9dd73959-96d3-5565-aaaa-e6a65d9ad4ab_image_3.jpg HTTP/1.1" 201 0
2025-12-04 10:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3708538-3688559-4.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3708538-3688559-4.jpg saved to cache
2025-12-04 10:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9dd73959-96d3-5565-aaaa-e6a65d9ad4ab
2025-12-04 10:06:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd1ec90>
2025-12-04 10:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:06:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dd73959-96d3-5565-aaaa-e6a65d9ad4ab/9dd73959-96d3-5565-aaaa-e6a65d9ad4ab_image_7.jpg HTTP/1.1" 201 0
2025-12-04 10:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3708538-3688559-16.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3708538-3688559-16.jpg saved to cache
2025-12-04 10:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9dd73959-96d3-5565-aaaa-e6a65d9ad4ab
2025-12-04 10:06:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cceb0ad0>
2025-12-04 10:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:06:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dd73959-96d3-5565-aaaa-e6a65d9ad4ab/9dd73959-96d3-5565-aaaa-e6a65d9ad4ab_image_5.jpg HTTP/1.1" 201 0
2025-12-04 10:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3708538-3688559-13.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3708538-3688559-13.jpg saved to cache
2025-12-04 10:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9dd73959-96d3-5565-aaaa-e6a65d9ad4ab
2025-12-04 10:06:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cceb3310>
2025-12-04 10:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:06:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dd73959-96d3-5565-aaaa-e6a65d9ad4ab/9dd73959-96d3-5565-aaaa-e6a65d9ad4ab_image_0.jpg HTTP/1.1" 201 0
2025-12-04 10:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3708538-3688559-1.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3708538-3688559-1.jpg saved to cache
2025-12-04 10:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9dd73959-96d3-5565-aaaa-e6a65d9ad4ab
2025-12-04 10:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3708538-3688559-42.jpg> (referer: None)
2025-12-04 10:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3708538-3688559-28.jpg> (referer: None)
2025-12-04 10:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VAUXHALL/ASTRA?id=3694568&returnUrl=%2Fsearch%3FPage%3D4%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233694568&indx=344> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 10:06:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd326d0>
2025-12-04 10:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:06:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dd73959-96d3-5565-aaaa-e6a65d9ad4ab/9dd73959-96d3-5565-aaaa-e6a65d9ad4ab_image_4.jpg HTTP/1.1" 201 0
2025-12-04 10:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3708538-3688559-6.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3708538-3688559-6.jpg saved to cache
2025-12-04 10:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9dd73959-96d3-5565-aaaa-e6a65d9ad4ab
2025-12-04 10:06:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6ce090>
2025-12-04 10:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 10:06:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b81e6d8-b03c-5a08-b62b-f3cfc1b0bb9f/1b81e6d8-b03c-5a08-b62b-f3cfc1b0bb9f_expert_report_file_8d5a2983-ae4e-4c26-b172-b5026759a01b.pdf HTTP/1.1" 201 0
2025-12-04 10:06:43 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 1b81e6d8-b03c-5a08-b62b-f3cfc1b0bb9f
2025-12-04 10:06:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1b81e6d8-b03c-5a08-b62b-f3cfc1b0bb9f, skipping ID generation
2025-12-04 10:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 1b81e6d8-b03c-5a08-b62b-f3cfc1b0bb9f
2025-12-04 10:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb81c15c2-fe80-4e2a-b533-9e285957ec70_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b81c15c2-fe80-4e2a-b533-9e285957ec70_ext_7.jpg already downloaded
2025-12-04 10:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb81c15c2-fe80-4e2a-b533-9e285957ec70_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b81c15c2-fe80-4e2a-b533-9e285957ec70_ext_7.jpg already downloaded
2025-12-04 10:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb81c15c2-fe80-4e2a-b533-9e285957ec70_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b81c15c2-fe80-4e2a-b533-9e285957ec70_ext_6.jpg already downloaded
2025-12-04 10:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb81c15c2-fe80-4e2a-b533-9e285957ec70_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b81c15c2-fe80-4e2a-b533-9e285957ec70_ext_1.jpg already downloaded
2025-12-04 10:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb81c15c2-fe80-4e2a-b533-9e285957ec70_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b81c15c2-fe80-4e2a-b533-9e285957ec70_5.jpg already downloaded
2025-12-04 10:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb81c15c2-fe80-4e2a-b533-9e285957ec70_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b81c15c2-fe80-4e2a-b533-9e285957ec70_4.jpg already downloaded
2025-12-04 10:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb81c15c2-fe80-4e2a-b533-9e285957ec70_11.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b81c15c2-fe80-4e2a-b533-9e285957ec70_11.jpg already downloaded
2025-12-04 10:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb81c15c2-fe80-4e2a-b533-9e285957ec70_10.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b81c15c2-fe80-4e2a-b533-9e285957ec70_10.jpg already downloaded
2025-12-04 10:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb81c15c2-fe80-4e2a-b533-9e285957ec70_9.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b81c15c2-fe80-4e2a-b533-9e285957ec70_9.jpg already downloaded
2025-12-04 10:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb81c15c2-fe80-4e2a-b533-9e285957ec70_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b81c15c2-fe80-4e2a-b533-9e285957ec70_ext_2.jpg already downloaded
2025-12-04 10:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb81c15c2-fe80-4e2a-b533-9e285957ec70_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b81c15c2-fe80-4e2a-b533-9e285957ec70_ext_5.jpg already downloaded
2025-12-04 10:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb81c15c2-fe80-4e2a-b533-9e285957ec70_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b81c15c2-fe80-4e2a-b533-9e285957ec70_ext_3.jpg already downloaded
2025-12-04 10:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb81c15c2-fe80-4e2a-b533-9e285957ec70_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b81c15c2-fe80-4e2a-b533-9e285957ec70_ext_4.jpg already downloaded
2025-12-04 10:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3696200-3990901-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3696200-3990901-13.jpg already downloaded
2025-12-04 10:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3696200-3990901-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3696200-3990901-1000.jpg already downloaded
2025-12-04 10:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3696200-3990901-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3696200-3990901-1001.jpg already downloaded
2025-12-04 10:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3696200-3990901-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3696200-3990901-1002.jpg already downloaded
2025-12-04 10:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3696200-3990901-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3696200-3990901-1003.jpg already downloaded
2025-12-04 10:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3696200-3990901-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3696200-3990901-1004.jpg already downloaded
2025-12-04 10:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3696200-3990901-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3696200-3990901-1005.jpg already downloaded
2025-12-04 10:06:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 1b81e6d8-b03c-5a08-b62b-f3cfc1b0bb9f, identifier: 3696200
2025-12-04 10:06:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce93b10>
2025-12-04 10:06:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:06:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bb83e1f-59e6-5bec-b8e0-b3e9161a4c7a/3bb83e1f-59e6-5bec-b8e0-b3e9161a4c7a_expert_report_file_7baac3e5-d3dc-4587-83b9-d09b11f540ce.pdf HTTP/1.1" 201 0
2025-12-04 10:06:44 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 3bb83e1f-59e6-5bec-b8e0-b3e9161a4c7a
2025-12-04 10:06:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3bb83e1f-59e6-5bec-b8e0-b3e9161a4c7a, skipping ID generation
2025-12-04 10:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 18 photos for item 3bb83e1f-59e6-5bec-b8e0-b3e9161a4c7a
2025-12-04 10:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-64cb96c0-4d3d-46c4-a135-967c31f3cb5a.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-64cb96c0-4d3d-46c4-a135-967c31f3cb5a.jpg already downloaded
2025-12-04 10:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-f4a64805-f138-4d7d-91bc-453a358c9857.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-f4a64805-f138-4d7d-91bc-453a358c9857.jpg already downloaded
2025-12-04 10:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-de5fea3c-44fa-4022-b991-0dfe40c405af.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-de5fea3c-44fa-4022-b991-0dfe40c405af.jpg already downloaded
2025-12-04 10:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-68dc75a1-08fc-4d6e-aaa6-afe58c9126b8.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-68dc75a1-08fc-4d6e-aaa6-afe58c9126b8.jpg already downloaded
2025-12-04 10:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-da6fa62d-384e-4fad-825b-c5debd47005d.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-da6fa62d-384e-4fad-825b-c5debd47005d.jpg already downloaded
2025-12-04 10:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-d40053af-eb4a-4f82-8e50-b9a9a57788a4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-d40053af-eb4a-4f82-8e50-b9a9a57788a4.jpg already downloaded
2025-12-04 10:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-49ea3e44-85b1-4dce-a0d3-b8a7a147e189.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-49ea3e44-85b1-4dce-a0d3-b8a7a147e189.jpg already downloaded
2025-12-04 10:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-d4263b65-03a5-4838-9c14-d426a167ae71.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-d4263b65-03a5-4838-9c14-d426a167ae71.jpg already downloaded
2025-12-04 10:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-a4ee7007-d569-498f-9a7f-bb479784e126.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-a4ee7007-d569-498f-9a7f-bb479784e126.jpg already downloaded
2025-12-04 10:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-9c08cd32-35b0-4962-8d5f-b591d9f2bcf8.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-9c08cd32-35b0-4962-8d5f-b591d9f2bcf8.jpg already downloaded
2025-12-04 10:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-28945206-4839-47a2-9d89-9ede6d2f69aa.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-28945206-4839-47a2-9d89-9ede6d2f69aa.jpg already downloaded
2025-12-04 10:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-0e2d7be6-bb26-4852-b91f-65d1dd2792d2.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-0e2d7be6-bb26-4852-b91f-65d1dd2792d2.jpg already downloaded
2025-12-04 10:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3696571-3997428-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3696571-3997428-13.jpg already downloaded
2025-12-04 10:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3696571-3997428-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3696571-3997428-1000.jpg already downloaded
2025-12-04 10:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3696571-3997428-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3696571-3997428-1001.jpg already downloaded
2025-12-04 10:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3696571-3997428-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3696571-3997428-1002.jpg already downloaded
2025-12-04 10:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3696571-3997428-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3696571-3997428-1003.jpg already downloaded
2025-12-04 10:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3696571-3997428-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3696571-3997428-1004.jpg already downloaded
2025-12-04 10:06:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 3bb83e1f-59e6-5bec-b8e0-b3e9161a4c7a, identifier: 3696571
2025-12-04 10:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3708538-3688559-1003.jpg> (referer: None)
2025-12-04 10:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3708538-3688559-1000.jpg> (referer: None)
2025-12-04 10:06:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 1b81e6d8-b03c-5a08-b62b-f3cfc1b0bb9f with identifier: 3696200
2025-12-04 10:06:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 1b81e6d8-b03c-5a08-b62b-f3cfc1b0bb9f with identifier: 3696200
2025-12-04 10:06:45 [scrapy.core.scraper] INFO: Dropped: Dropping expired listing: 1b81e6d8-b03c-5a08-b62b-f3cfc1b0bb9f with expiration date: 2025-12-04T09:00:00Z
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b81e6d8-b03c-5a08-b62b-f3cfc1b0bb9f/1b81e6d8-b03c-5a08-b62b-f3cfc1b0bb9f_expert_report_file_8d5a2983-ae4e-4c26-b172-b5026759a01b.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003696200-01975592-008.pdf',
 'color': 'SILVER',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '1b81e6d8-b03c-5a08-b62b-f3cfc1b0bb9f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'LT67OTA',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/LAND%20ROVER/DISCOVERY%20SPORT?id=3696200',
 'listing': 'auction',
 'location': 'Leeds',
 'make': 'LAND ROVER',
 'model': 'DISCOVERY SPORT',
 'odometer': 95164,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 21,
 'photo_urls': ['http://images.manheim.co.uk/images/units/zoom/b81c15c2-fe80-4e2a-b533-9e285957ec70_ext_7.jpg',
                'http://images.manheim.co.uk/images/units/zoom/b81c15c2-fe80-4e2a-b533-9e285957ec70_ext_7.jpg',
                'http://images.manheim.co.uk/images/units/zoom/b81c15c2-fe80-4e2a-b533-9e285957ec70_ext_6.jpg',
                'http://images.manheim.co.uk/images/units/zoom/b81c15c2-fe80-4e2a-b533-9e285957ec70_ext_1.jpg',
                'http://images.manheim.co.uk/images/units/zoom/b81c15c2-fe80-4e2a-b533-9e285957ec70_5.jpg',
                'http://images.manheim.co.uk/images/units/zoom/b81c15c2-fe80-4e2a-b533-9e285957ec70_4.jpg',
                'http://images.manheim.co.uk/images/units/zoom/b81c15c2-fe80-4e2a-b533-9e285957ec70_11.jpg',
                'http://images.manheim.co.uk/images/units/zoom/b81c15c2-fe80-4e2a-b533-9e285957ec70_10.jpg',
                'http://images.manheim.co.uk/images/units/zoom/b81c15c2-fe80-4e2a-b533-9e285957ec70_9.jpg',
                'http://images.manheim.co.uk/images/units/zoom/b81c15c2-fe80-4e2a-b533-9e285957ec70_ext_2.jpg',
                'http://images.manheim.co.uk/images/units/zoom/b81c15c2-fe80-4e2a-b533-9e285957ec70_ext_5.jpg',
                'http://images.manheim.co.uk/images/units/zoom/b81c15c2-fe80-4e2a-b533-9e285957ec70_ext_3.jpg',
                'http://images.manheim.co.uk/images/units/zoom/b81c15c2-fe80-4e2a-b533-9e285957ec70_ext_4.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3696200-3990901-13.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3696200-3990901-1000.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3696200-3990901-1001.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3696200-3990901-1002.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3696200-3990901-1003.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3696200-3990901-1004.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3696200-3990901-1005.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b81e6d8-b03c-5a08-b62b-f3cfc1b0bb9f/1b81e6d8-b03c-5a08-b62b-f3cfc1b0bb9f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 176316,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b81c15c2-fe80-4e2a-b533-9e285957ec70_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b81e6d8-b03c-5a08-b62b-f3cfc1b0bb9f/1b81e6d8-b03c-5a08-b62b-f3cfc1b0bb9f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 176316,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b81c15c2-fe80-4e2a-b533-9e285957ec70_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b81e6d8-b03c-5a08-b62b-f3cfc1b0bb9f/1b81e6d8-b03c-5a08-b62b-f3cfc1b0bb9f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 244064,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b81c15c2-fe80-4e2a-b533-9e285957ec70_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b81e6d8-b03c-5a08-b62b-f3cfc1b0bb9f/1b81e6d8-b03c-5a08-b62b-f3cfc1b0bb9f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 176510,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b81c15c2-fe80-4e2a-b533-9e285957ec70_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b81e6d8-b03c-5a08-b62b-f3cfc1b0bb9f/1b81e6d8-b03c-5a08-b62b-f3cfc1b0bb9f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 166180,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b81c15c2-fe80-4e2a-b533-9e285957ec70_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b81e6d8-b03c-5a08-b62b-f3cfc1b0bb9f/1b81e6d8-b03c-5a08-b62b-f3cfc1b0bb9f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 176928,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b81c15c2-fe80-4e2a-b533-9e285957ec70_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b81e6d8-b03c-5a08-b62b-f3cfc1b0bb9f/1b81e6d8-b03c-5a08-b62b-f3cfc1b0bb9f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 157582,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b81c15c2-fe80-4e2a-b533-9e285957ec70_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b81e6d8-b03c-5a08-b62b-f3cfc1b0bb9f/1b81e6d8-b03c-5a08-b62b-f3cfc1b0bb9f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 169970,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b81c15c2-fe80-4e2a-b533-9e285957ec70_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b81e6d8-b03c-5a08-b62b-f3cfc1b0bb9f/1b81e6d8-b03c-5a08-b62b-f3cfc1b0bb9f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 176555,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b81c15c2-fe80-4e2a-b533-9e285957ec70_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b81e6d8-b03c-5a08-b62b-f3cfc1b0bb9f/1b81e6d8-b03c-5a08-b62b-f3cfc1b0bb9f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 284184,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b81c15c2-fe80-4e2a-b533-9e285957ec70_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b81e6d8-b03c-5a08-b62b-f3cfc1b0bb9f/1b81e6d8-b03c-5a08-b62b-f3cfc1b0bb9f_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 226937,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b81c15c2-fe80-4e2a-b533-9e285957ec70_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b81e6d8-b03c-5a08-b62b-f3cfc1b0bb9f/1b81e6d8-b03c-5a08-b62b-f3cfc1b0bb9f_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 262971,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b81c15c2-fe80-4e2a-b533-9e285957ec70_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b81e6d8-b03c-5a08-b62b-f3cfc1b0bb9f/1b81e6d8-b03c-5a08-b62b-f3cfc1b0bb9f_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 274458,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b81c15c2-fe80-4e2a-b533-9e285957ec70_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b81e6d8-b03c-5a08-b62b-f3cfc1b0bb9f/1b81e6d8-b03c-5a08-b62b-f3cfc1b0bb9f_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 454450,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3696200-3990901-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b81e6d8-b03c-5a08-b62b-f3cfc1b0bb9f/1b81e6d8-b03c-5a08-b62b-f3cfc1b0bb9f_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 248991,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3696200-3990901-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b81e6d8-b03c-5a08-b62b-f3cfc1b0bb9f/1b81e6d8-b03c-5a08-b62b-f3cfc1b0bb9f_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 246657,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3696200-3990901-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b81e6d8-b03c-5a08-b62b-f3cfc1b0bb9f/1b81e6d8-b03c-5a08-b62b-f3cfc1b0bb9f_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 349855,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3696200-3990901-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b81e6d8-b03c-5a08-b62b-f3cfc1b0bb9f/1b81e6d8-b03c-5a08-b62b-f3cfc1b0bb9f_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 260626,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3696200-3990901-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b81e6d8-b03c-5a08-b62b-f3cfc1b0bb9f/1b81e6d8-b03c-5a08-b62b-f3cfc1b0bb9f_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 307491,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3696200-3990901-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b81e6d8-b03c-5a08-b62b-f3cfc1b0bb9f/1b81e6d8-b03c-5a08-b62b-f3cfc1b0bb9f_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 200539,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3696200-3990901-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-11',
 'seller_name': 'Motor Dough',
 'title': 'LAND ROVER DISCOVERY SPORT 2.0 TD4 180 HSE 5dr Auto',
 'transmission': 'automatic',
 'trim': '2.0 TD4 180 HSE 5dr Auto',
 'year': 2017}
2025-12-04 10:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273696200%27 HTTP/1.1" 200 None
2025-12-04 10:06:45 [manheim.gb] INFO: Saving data for 3696200: {'created_time': 1764842805.423512, 'last_price_update_time': 1764842805.423521, 'auction_closing_time': 1764838800.0}
2025-12-04 10:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3696200') HTTP/1.1" 204 0
2025-12-04 10:06:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 3bb83e1f-59e6-5bec-b8e0-b3e9161a4c7a with identifier: 3696571
2025-12-04 10:06:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 3bb83e1f-59e6-5bec-b8e0-b3e9161a4c7a with identifier: 3696571
2025-12-04 10:06:45 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 3bb83e1f-59e6-5bec-b8e0-b3e9161a4c7a with identifier: 3696571 to the API
2025-12-04 10:06:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 10:06:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 10:06:45 [scrapy.core.scraper] DEBUG: Scraped from <200 http://ecr.manheim.co.uk/pdf/MOL-0003696571-01983522-003.pdf>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bb83e1f-59e6-5bec-b8e0-b3e9161a4c7a/3bb83e1f-59e6-5bec-b8e0-b3e9161a4c7a_expert_report_file_7baac3e5-d3dc-4587-83b9-d09b11f540ce.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003696571-01983522-003.pdf',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '1.5L',
 'expiration_date': '2025-12-05T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '3bb83e1f-59e6-5bec-b8e0-b3e9161a4c7a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'KF19VPP',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/GOLF?id=3696571',
 'listing': 'directbuy',
 'location': 'Washington',
 'make': 'VOLKSWAGEN',
 'model': 'GOLF',
 'odometer': 17647,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 18,
 'photo_urls': ['http://images.manheim.co.uk/images/units/zoom/Img-64cb96c0-4d3d-46c4-a135-967c31f3cb5a.jpg',
                'http://images.manheim.co.uk/images/units/zoom/Img-f4a64805-f138-4d7d-91bc-453a358c9857.jpg',
                'http://images.manheim.co.uk/images/units/zoom/Img-de5fea3c-44fa-4022-b991-0dfe40c405af.jpg',
                'http://images.manheim.co.uk/images/units/zoom/Img-68dc75a1-08fc-4d6e-aaa6-afe58c9126b8.jpg',
                'http://images.manheim.co.uk/images/units/zoom/Img-da6fa62d-384e-4fad-825b-c5debd47005d.jpg',
                'http://images.manheim.co.uk/images/units/zoom/Img-d40053af-eb4a-4f82-8e50-b9a9a57788a4.jpg',
                'http://images.manheim.co.uk/images/units/zoom/Img-49ea3e44-85b1-4dce-a0d3-b8a7a147e189.jpg',
                'http://images.manheim.co.uk/images/units/zoom/Img-d4263b65-03a5-4838-9c14-d426a167ae71.jpg',
                'http://images.manheim.co.uk/images/units/zoom/Img-a4ee7007-d569-498f-9a7f-bb479784e126.jpg',
                'http://images.manheim.co.uk/images/units/zoom/Img-9c08cd32-35b0-4962-8d5f-b591d9f2bcf8.jpg',
                'http://images.manheim.co.uk/images/units/zoom/Img-28945206-4839-47a2-9d89-9ede6d2f69aa.jpg',
                'http://images.manheim.co.uk/images/units/zoom/Img-0e2d7be6-bb26-4852-b91f-65d1dd2792d2.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3696571-3997428-13.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3696571-3997428-1000.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3696571-3997428-1001.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3696571-3997428-1002.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3696571-3997428-1003.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3696571-3997428-1004.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bb83e1f-59e6-5bec-b8e0-b3e9161a4c7a/3bb83e1f-59e6-5bec-b8e0-b3e9161a4c7a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 206326,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/Img-64cb96c0-4d3d-46c4-a135-967c31f3cb5a.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bb83e1f-59e6-5bec-b8e0-b3e9161a4c7a/3bb83e1f-59e6-5bec-b8e0-b3e9161a4c7a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 231815,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/Img-f4a64805-f138-4d7d-91bc-453a358c9857.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bb83e1f-59e6-5bec-b8e0-b3e9161a4c7a/3bb83e1f-59e6-5bec-b8e0-b3e9161a4c7a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 175975,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/Img-de5fea3c-44fa-4022-b991-0dfe40c405af.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bb83e1f-59e6-5bec-b8e0-b3e9161a4c7a/3bb83e1f-59e6-5bec-b8e0-b3e9161a4c7a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 211010,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/Img-68dc75a1-08fc-4d6e-aaa6-afe58c9126b8.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bb83e1f-59e6-5bec-b8e0-b3e9161a4c7a/3bb83e1f-59e6-5bec-b8e0-b3e9161a4c7a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 193427,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/Img-da6fa62d-384e-4fad-825b-c5debd47005d.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bb83e1f-59e6-5bec-b8e0-b3e9161a4c7a/3bb83e1f-59e6-5bec-b8e0-b3e9161a4c7a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 199719,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/Img-d40053af-eb4a-4f82-8e50-b9a9a57788a4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bb83e1f-59e6-5bec-b8e0-b3e9161a4c7a/3bb83e1f-59e6-5bec-b8e0-b3e9161a4c7a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 190291,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/Img-49ea3e44-85b1-4dce-a0d3-b8a7a147e189.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bb83e1f-59e6-5bec-b8e0-b3e9161a4c7a/3bb83e1f-59e6-5bec-b8e0-b3e9161a4c7a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 173233,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/Img-d4263b65-03a5-4838-9c14-d426a167ae71.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bb83e1f-59e6-5bec-b8e0-b3e9161a4c7a/3bb83e1f-59e6-5bec-b8e0-b3e9161a4c7a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 226719,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/Img-a4ee7007-d569-498f-9a7f-bb479784e126.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bb83e1f-59e6-5bec-b8e0-b3e9161a4c7a/3bb83e1f-59e6-5bec-b8e0-b3e9161a4c7a_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 205690,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/Img-9c08cd32-35b0-4962-8d5f-b591d9f2bcf8.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bb83e1f-59e6-5bec-b8e0-b3e9161a4c7a/3bb83e1f-59e6-5bec-b8e0-b3e9161a4c7a_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 221506,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/Img-28945206-4839-47a2-9d89-9ede6d2f69aa.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bb83e1f-59e6-5bec-b8e0-b3e9161a4c7a/3bb83e1f-59e6-5bec-b8e0-b3e9161a4c7a_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 263135,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/Img-0e2d7be6-bb26-4852-b91f-65d1dd2792d2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bb83e1f-59e6-5bec-b8e0-b3e9161a4c7a/3bb83e1f-59e6-5bec-b8e0-b3e9161a4c7a_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 380649,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3696571-3997428-13.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bb83e1f-59e6-5bec-b8e0-b3e9161a4c7a/3bb83e1f-59e6-5bec-b8e0-b3e9161a4c7a_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 263800,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3696571-3997428-1000.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bb83e1f-59e6-5bec-b8e0-b3e9161a4c7a/3bb83e1f-59e6-5bec-b8e0-b3e9161a4c7a_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 452127,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3696571-3997428-1001.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bb83e1f-59e6-5bec-b8e0-b3e9161a4c7a/3bb83e1f-59e6-5bec-b8e0-b3e9161a4c7a_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115851,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3696571-3997428-1002.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bb83e1f-59e6-5bec-b8e0-b3e9161a4c7a/3bb83e1f-59e6-5bec-b8e0-b3e9161a4c7a_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107554,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3696571-3997428-1003.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bb83e1f-59e6-5bec-b8e0-b3e9161a4c7a/3bb83e1f-59e6-5bec-b8e0-b3e9161a4c7a_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 183583,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3696571-3997428-1004.jpg',
             'Width': 1500}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-19',
 'seller_name': 'OK Fleet Disposals Ltd',
 'title': 'VOLKSWAGEN GOLF 1.5 TSI EVO Match 5dr DSG',
 'transmission': 'automatic',
 'trim': '1.5 TSI EVO Match 5dr DSG',
 'year': 2019}
2025-12-04 10:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273696571%27 HTTP/1.1" 200 None
2025-12-04 10:06:45 [manheim.gb] INFO: Saving data for 3696571: {'created_time': 1764842805.815217, 'last_price_update_time': 1764842805.815226, 'auction_closing_time': 1764925200.0}
2025-12-04 10:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3696571') HTTP/1.1" 204 0
2025-12-04 10:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3708538-3688559-44.jpg> (referer: None)
2025-12-04 10:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3708538-3688559-43.jpg> (referer: None)
2025-12-04 10:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3708538-3688559-8.jpg> (referer: None)
2025-12-04 10:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003695980-01857253-003.pdf> (referer: None)
2025-12-04 10:06:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5471d0>
2025-12-04 10:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 10:06:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dd73959-96d3-5565-aaaa-e6a65d9ad4ab/9dd73959-96d3-5565-aaaa-e6a65d9ad4ab_image_9.jpg HTTP/1.1" 201 0
2025-12-04 10:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3708538-3688559-42.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3708538-3688559-42.jpg saved to cache
2025-12-04 10:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9dd73959-96d3-5565-aaaa-e6a65d9ad4ab
2025-12-04 10:06:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd0a2150>
2025-12-04 10:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:06:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dd73959-96d3-5565-aaaa-e6a65d9ad4ab/9dd73959-96d3-5565-aaaa-e6a65d9ad4ab_image_8.jpg HTTP/1.1" 201 0
2025-12-04 10:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3708538-3688559-28.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3708538-3688559-28.jpg saved to cache
2025-12-04 10:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9dd73959-96d3-5565-aaaa-e6a65d9ad4ab
2025-12-04 10:06:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d3c4703-d25f-5d38-acb2-8bc444613975 with identifier: 3694568
2025-12-04 10:06:46 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 5d3c4703-d25f-5d38-acb2-8bc444613975
2025-12-04 10:06:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc653010>
2025-12-04 10:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:06:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dd73959-96d3-5565-aaaa-e6a65d9ad4ab/9dd73959-96d3-5565-aaaa-e6a65d9ad4ab_image_15.jpg HTTP/1.1" 201 0
2025-12-04 10:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3708538-3688559-1003.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3708538-3688559-1003.jpg saved to cache
2025-12-04 10:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 9dd73959-96d3-5565-aaaa-e6a65d9ad4ab
2025-12-04 10:06:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc7ca390>
2025-12-04 10:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:06:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dd73959-96d3-5565-aaaa-e6a65d9ad4ab/9dd73959-96d3-5565-aaaa-e6a65d9ad4ab_image_12.jpg HTTP/1.1" 201 0
2025-12-04 10:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3708538-3688559-1000.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3708538-3688559-1000.jpg saved to cache
2025-12-04 10:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 9dd73959-96d3-5565-aaaa-e6a65d9ad4ab
2025-12-04 10:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3708538-3688559-1007.jpg> (referer: None)
2025-12-04 10:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3708538-3688559-1006.jpg> (referer: None)
2025-12-04 10:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3708538-3688559-1005.jpg> (referer: None)
2025-12-04 10:06:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd480d0>
2025-12-04 10:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:06:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dd73959-96d3-5565-aaaa-e6a65d9ad4ab/9dd73959-96d3-5565-aaaa-e6a65d9ad4ab_image_11.jpg HTTP/1.1" 201 0
2025-12-04 10:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3708538-3688559-44.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3708538-3688559-44.jpg saved to cache
2025-12-04 10:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 9dd73959-96d3-5565-aaaa-e6a65d9ad4ab
2025-12-04 10:06:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6db650>
2025-12-04 10:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:06:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dd73959-96d3-5565-aaaa-e6a65d9ad4ab/9dd73959-96d3-5565-aaaa-e6a65d9ad4ab_image_10.jpg HTTP/1.1" 201 0
2025-12-04 10:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3708538-3688559-43.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3708538-3688559-43.jpg saved to cache
2025-12-04 10:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 9dd73959-96d3-5565-aaaa-e6a65d9ad4ab
2025-12-04 10:06:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce676d0>
2025-12-04 10:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 10:06:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dd73959-96d3-5565-aaaa-e6a65d9ad4ab/9dd73959-96d3-5565-aaaa-e6a65d9ad4ab_image_6.jpg HTTP/1.1" 201 0
2025-12-04 10:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3708538-3688559-8.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3708538-3688559-8.jpg saved to cache
2025-12-04 10:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9dd73959-96d3-5565-aaaa-e6a65d9ad4ab
2025-12-04 10:06:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc72eb10>
2025-12-04 10:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:06:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53095d01-1a66-5767-9416-77f431c3c7f5/53095d01-1a66-5767-9416-77f431c3c7f5_expert_report_file_e0c53b23-7ecf-4d6d-833e-e33a1e24550b.pdf HTTP/1.1" 201 0
2025-12-04 10:06:48 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 53095d01-1a66-5767-9416-77f431c3c7f5
2025-12-04 10:06:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 53095d01-1a66-5767-9416-77f431c3c7f5, skipping ID generation
2025-12-04 10:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 53095d01-1a66-5767-9416-77f431c3c7f5
2025-12-04 10:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8e337748-4139-4d5b-bebe-205362a916f0_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8e337748-4139-4d5b-bebe-205362a916f0_ext_7.jpg not downloaded yet
2025-12-04 10:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3708538-3688559-1001.jpg> (referer: None)
2025-12-04 10:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3708538-3688559-1002.jpg> (referer: None)
2025-12-04 10:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3708538-3688559-1004.jpg> (referer: None)
2025-12-04 10:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8e337748-4139-4d5b-bebe-205362a916f0_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8e337748-4139-4d5b-bebe-205362a916f0_ext_7.jpg not downloaded yet
2025-12-04 10:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/CITROEN/C3PICASSO?id=3719784&returnUrl=%2Fsearch%3FPage%3D4%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233719784&indx=351> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 10:06:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 10:06:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 10:06:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc602590>
2025-12-04 10:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:06:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dd73959-96d3-5565-aaaa-e6a65d9ad4ab/9dd73959-96d3-5565-aaaa-e6a65d9ad4ab_image_19.jpg HTTP/1.1" 201 0
2025-12-04 10:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3708538-3688559-1007.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3708538-3688559-1007.jpg saved to cache
2025-12-04 10:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 9dd73959-96d3-5565-aaaa-e6a65d9ad4ab
2025-12-04 10:06:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc63f210>
2025-12-04 10:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:06:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dd73959-96d3-5565-aaaa-e6a65d9ad4ab/9dd73959-96d3-5565-aaaa-e6a65d9ad4ab_image_18.jpg HTTP/1.1" 201 0
2025-12-04 10:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3708538-3688559-1006.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3708538-3688559-1006.jpg saved to cache
2025-12-04 10:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 9dd73959-96d3-5565-aaaa-e6a65d9ad4ab
2025-12-04 10:06:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc63e1d0>
2025-12-04 10:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:06:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dd73959-96d3-5565-aaaa-e6a65d9ad4ab/9dd73959-96d3-5565-aaaa-e6a65d9ad4ab_image_17.jpg HTTP/1.1" 201 0
2025-12-04 10:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3708538-3688559-1005.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3708538-3688559-1005.jpg saved to cache
2025-12-04 10:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 9dd73959-96d3-5565-aaaa-e6a65d9ad4ab
2025-12-04 10:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8e337748-4139-4d5b-bebe-205362a916f0_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8e337748-4139-4d5b-bebe-205362a916f0_ext_6.jpg not downloaded yet
2025-12-04 10:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8e337748-4139-4d5b-bebe-205362a916f0_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8e337748-4139-4d5b-bebe-205362a916f0_ext_1.jpg not downloaded yet
2025-12-04 10:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8e337748-4139-4d5b-bebe-205362a916f0_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8e337748-4139-4d5b-bebe-205362a916f0_5.jpg not downloaded yet
2025-12-04 10:06:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ce4e7310>
2025-12-04 10:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:06:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dd73959-96d3-5565-aaaa-e6a65d9ad4ab/9dd73959-96d3-5565-aaaa-e6a65d9ad4ab_image_13.jpg HTTP/1.1" 201 0
2025-12-04 10:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3708538-3688559-1001.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3708538-3688559-1001.jpg saved to cache
2025-12-04 10:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 9dd73959-96d3-5565-aaaa-e6a65d9ad4ab
2025-12-04 10:06:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd88dd0>
2025-12-04 10:06:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:06:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dd73959-96d3-5565-aaaa-e6a65d9ad4ab/9dd73959-96d3-5565-aaaa-e6a65d9ad4ab_image_14.jpg HTTP/1.1" 201 0
2025-12-04 10:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3708538-3688559-1002.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3708538-3688559-1002.jpg saved to cache
2025-12-04 10:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 9dd73959-96d3-5565-aaaa-e6a65d9ad4ab
2025-12-04 10:06:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc58dc10>
2025-12-04 10:06:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:06:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dd73959-96d3-5565-aaaa-e6a65d9ad4ab/9dd73959-96d3-5565-aaaa-e6a65d9ad4ab_image_16.jpg HTTP/1.1" 201 0
2025-12-04 10:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3708538-3688559-1004.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3708538-3688559-1004.jpg saved to cache
2025-12-04 10:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 9dd73959-96d3-5565-aaaa-e6a65d9ad4ab
2025-12-04 10:06:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9dd73959-96d3-5565-aaaa-e6a65d9ad4ab, skipping ID generation
2025-12-04 10:06:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9dd73959-96d3-5565-aaaa-e6a65d9ad4ab with scrape type 1
2025-12-04 10:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 9dd73959-96d3-5565-aaaa-e6a65d9ad4ab from tracking dictionaries
2025-12-04 10:06:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9dd73959-96d3-5565-aaaa-e6a65d9ad4ab sending to next pipeline
2025-12-04 10:06:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 9dd73959-96d3-5565-aaaa-e6a65d9ad4ab, identifier: 3708538
2025-12-04 10:06:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 836f12a0-cbbe-5a79-8594-40f844ef76d6 with identifier: 3719784
2025-12-04 10:06:50 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 836f12a0-cbbe-5a79-8594-40f844ef76d6
2025-12-04 10:06:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 9dd73959-96d3-5565-aaaa-e6a65d9ad4ab with identifier: 3708538
2025-12-04 10:06:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 9dd73959-96d3-5565-aaaa-e6a65d9ad4ab with identifier: 3708538
2025-12-04 10:06:51 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 9dd73959-96d3-5565-aaaa-e6a65d9ad4ab with identifier: 3708538 to the API
2025-12-04 10:06:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 10:06:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 10:06:51 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/insp-0001-3708538-3688559-1004.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'car_expert_report_source_url': None,
 'color': 'BLUE',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': '2025-12-12T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '9dd73959-96d3-5565-aaaa-e6a65d9ad4ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'YB70LHY',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VAUXHALL/CORSA?id=3708538',
 'listing': 'auction',
 'location': 'Birmingham',
 'make': 'VAUXHALL',
 'model': 'CORSA',
 'odometer': 42305,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 70,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dd73959-96d3-5565-aaaa-e6a65d9ad4ab/9dd73959-96d3-5565-aaaa-e6a65d9ad4ab_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 444173,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3708538-3688559-1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dd73959-96d3-5565-aaaa-e6a65d9ad4ab/9dd73959-96d3-5565-aaaa-e6a65d9ad4ab_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 273741,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3708538-3688559-2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dd73959-96d3-5565-aaaa-e6a65d9ad4ab/9dd73959-96d3-5565-aaaa-e6a65d9ad4ab_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 216810,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3708538-3688559-3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dd73959-96d3-5565-aaaa-e6a65d9ad4ab/9dd73959-96d3-5565-aaaa-e6a65d9ad4ab_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 390631,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3708538-3688559-4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dd73959-96d3-5565-aaaa-e6a65d9ad4ab/9dd73959-96d3-5565-aaaa-e6a65d9ad4ab_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 482364,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3708538-3688559-6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dd73959-96d3-5565-aaaa-e6a65d9ad4ab/9dd73959-96d3-5565-aaaa-e6a65d9ad4ab_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 396839,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3708538-3688559-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dd73959-96d3-5565-aaaa-e6a65d9ad4ab/9dd73959-96d3-5565-aaaa-e6a65d9ad4ab_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 470376,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3708538-3688559-8.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dd73959-96d3-5565-aaaa-e6a65d9ad4ab/9dd73959-96d3-5565-aaaa-e6a65d9ad4ab_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 360736,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3708538-3688559-16.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dd73959-96d3-5565-aaaa-e6a65d9ad4ab/9dd73959-96d3-5565-aaaa-e6a65d9ad4ab_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 248415,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3708538-3688559-28.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dd73959-96d3-5565-aaaa-e6a65d9ad4ab/9dd73959-96d3-5565-aaaa-e6a65d9ad4ab_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 259732,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3708538-3688559-42.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dd73959-96d3-5565-aaaa-e6a65d9ad4ab/9dd73959-96d3-5565-aaaa-e6a65d9ad4ab_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 460263,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3708538-3688559-43.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dd73959-96d3-5565-aaaa-e6a65d9ad4ab/9dd73959-96d3-5565-aaaa-e6a65d9ad4ab_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 483853,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3708538-3688559-44.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dd73959-96d3-5565-aaaa-e6a65d9ad4ab/9dd73959-96d3-5565-aaaa-e6a65d9ad4ab_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 270671,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3708538-3688559-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dd73959-96d3-5565-aaaa-e6a65d9ad4ab/9dd73959-96d3-5565-aaaa-e6a65d9ad4ab_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 309307,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3708538-3688559-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dd73959-96d3-5565-aaaa-e6a65d9ad4ab/9dd73959-96d3-5565-aaaa-e6a65d9ad4ab_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 361746,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3708538-3688559-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dd73959-96d3-5565-aaaa-e6a65d9ad4ab/9dd73959-96d3-5565-aaaa-e6a65d9ad4ab_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 262028,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3708538-3688559-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dd73959-96d3-5565-aaaa-e6a65d9ad4ab/9dd73959-96d3-5565-aaaa-e6a65d9ad4ab_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 392005,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3708538-3688559-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dd73959-96d3-5565-aaaa-e6a65d9ad4ab/9dd73959-96d3-5565-aaaa-e6a65d9ad4ab_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 353313,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3708538-3688559-1005.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dd73959-96d3-5565-aaaa-e6a65d9ad4ab/9dd73959-96d3-5565-aaaa-e6a65d9ad4ab_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 317112,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3708538-3688559-1006.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dd73959-96d3-5565-aaaa-e6a65d9ad4ab/9dd73959-96d3-5565-aaaa-e6a65d9ad4ab_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 347643,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3708538-3688559-1007.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-30',
 'seller_name': 'Smiths Motor Group',
 'title': 'VAUXHALL CORSA 1.2 SE 5dr',
 'transmission': 'manual',
 'trim': '1.2 SE 5dr',
 'year': 2020}
2025-12-04 10:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273708538%27 HTTP/1.1" 200 None
2025-12-04 10:06:51 [manheim.gb] INFO: Saving data for 3708538: {'created_time': 1764842811.354821, 'last_price_update_time': 1764842811.354829, 'auction_closing_time': 1765530000.0}
2025-12-04 10:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3708538') HTTP/1.1" 204 0
2025-12-04 10:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8e337748-4139-4d5b-bebe-205362a916f0_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8e337748-4139-4d5b-bebe-205362a916f0_4.jpg not downloaded yet
2025-12-04 10:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8e337748-4139-4d5b-bebe-205362a916f0_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003695980-01857253-003.pdf)
2025-12-04 10:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/59096750-d732-4a04-93b4-5b26681153f6_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003739898-01981917-002.pdf)
2025-12-04 10:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1966868-4007672-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001966868-01991002-001.pdf)
2025-12-04 10:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/59096750-d732-4a04-93b4-5b26681153f6_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003739898-01981917-002.pdf)
2025-12-04 10:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8e337748-4139-4d5b-bebe-205362a916f0_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003695980-01857253-003.pdf)
2025-12-04 10:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8e337748-4139-4d5b-bebe-205362a916f0_11.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8e337748-4139-4d5b-bebe-205362a916f0_11.jpg not downloaded yet
2025-12-04 10:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1966868-4007672-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001966868-01991002-001.pdf)
2025-12-04 10:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1966868-4007672-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001966868-01991002-001.pdf)
2025-12-04 10:06:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 10:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1966868-4007672-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001966868-01991002-001.pdf)
2025-12-04 10:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8e337748-4139-4d5b-bebe-205362a916f0_10.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8e337748-4139-4d5b-bebe-205362a916f0_10.jpg not downloaded yet
2025-12-04 10:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8e337748-4139-4d5b-bebe-205362a916f0_9.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8e337748-4139-4d5b-bebe-205362a916f0_9.jpg not downloaded yet
2025-12-04 10:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8e337748-4139-4d5b-bebe-205362a916f0_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8e337748-4139-4d5b-bebe-205362a916f0_ext_2.jpg not downloaded yet
2025-12-04 10:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8e337748-4139-4d5b-bebe-205362a916f0_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8e337748-4139-4d5b-bebe-205362a916f0_ext_5.jpg not downloaded yet
2025-12-04 10:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8e337748-4139-4d5b-bebe-205362a916f0_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8e337748-4139-4d5b-bebe-205362a916f0_ext_3.jpg not downloaded yet
2025-12-04 10:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8e337748-4139-4d5b-bebe-205362a916f0_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8e337748-4139-4d5b-bebe-205362a916f0_ext_4.jpg not downloaded yet
2025-12-04 10:06:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc724850>
2025-12-04 10:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 10:06:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53095d01-1a66-5767-9416-77f431c3c7f5/53095d01-1a66-5767-9416-77f431c3c7f5_image_0.jpg HTTP/1.1" 201 0
2025-12-04 10:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8e337748-4139-4d5b-bebe-205362a916f0_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8e337748-4139-4d5b-bebe-205362a916f0_ext_7.jpg saved to cache
2025-12-04 10:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 53095d01-1a66-5767-9416-77f431c3c7f5
2025-12-04 10:06:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce69390>
2025-12-04 10:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:06:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a78d527e-dc6e-518f-ad6e-20beb5b60643/a78d527e-dc6e-518f-ad6e-20beb5b60643_image_1.jpg HTTP/1.1" 201 0
2025-12-04 10:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F59096750-d732-4a04-93b4-5b26681153f6_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/59096750-d732-4a04-93b4-5b26681153f6_ext_7.jpg saved to cache
2025-12-04 10:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a78d527e-dc6e-518f-ad6e-20beb5b60643
2025-12-04 10:06:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd56e90>
2025-12-04 10:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:06:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_941069ff-ef30-5bba-82bd-388d3cb54f16/941069ff-ef30-5bba-82bd-388d3cb54f16_image_14.jpg HTTP/1.1" 201 0
2025-12-04 10:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1966868-4007672-1000.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1966868-4007672-1000.jpg saved to cache
2025-12-04 10:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 941069ff-ef30-5bba-82bd-388d3cb54f16
2025-12-04 10:06:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce27090>
2025-12-04 10:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:06:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a78d527e-dc6e-518f-ad6e-20beb5b60643/a78d527e-dc6e-518f-ad6e-20beb5b60643_image_0.jpg HTTP/1.1" 201 0
2025-12-04 10:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F59096750-d732-4a04-93b4-5b26681153f6_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/59096750-d732-4a04-93b4-5b26681153f6_ext_7.jpg saved to cache
2025-12-04 10:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a78d527e-dc6e-518f-ad6e-20beb5b60643
2025-12-04 10:06:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a78d527e-dc6e-518f-ad6e-20beb5b60643, skipping ID generation
2025-12-04 10:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a78d527e-dc6e-518f-ad6e-20beb5b60643 from tracking dictionaries
2025-12-04 10:06:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a78d527e-dc6e-518f-ad6e-20beb5b60643 sending to next pipeline
2025-12-04 10:06:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: a78d527e-dc6e-518f-ad6e-20beb5b60643, identifier: 3739898
2025-12-04 10:06:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd4bbd0>
2025-12-04 10:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:06:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53095d01-1a66-5767-9416-77f431c3c7f5/53095d01-1a66-5767-9416-77f431c3c7f5_image_1.jpg HTTP/1.1" 201 0
2025-12-04 10:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8e337748-4139-4d5b-bebe-205362a916f0_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8e337748-4139-4d5b-bebe-205362a916f0_ext_7.jpg saved to cache
2025-12-04 10:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 53095d01-1a66-5767-9416-77f431c3c7f5
2025-12-04 10:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3695980-3843088-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3695980-3843088-13.jpg not downloaded yet
2025-12-04 10:06:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: a78d527e-dc6e-518f-ad6e-20beb5b60643 with identifier: 3739898
2025-12-04 10:06:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: a78d527e-dc6e-518f-ad6e-20beb5b60643 with identifier: 3739898
2025-12-04 10:06:53 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: a78d527e-dc6e-518f-ad6e-20beb5b60643 with identifier: 3739898 to the API
2025-12-04 10:06:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 10:06:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 10:06:53 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/59096750-d732-4a04-93b4-5b26681153f6_ext_7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a78d527e-dc6e-518f-ad6e-20beb5b60643/a78d527e-dc6e-518f-ad6e-20beb5b60643_expert_report_file_250e76e9-ddd6-4012-b67c-57aad05d8b04.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003739898-01981917-002.pdf',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '1.0L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'a78d527e-dc6e-518f-ad6e-20beb5b60643',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'KP21MTO',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/AUDI/A3?id=3739898',
 'listing': 'auction',
 'location': 'Leeds',
 'make': 'AUDI',
 'model': 'A3',
 'odometer': 80146,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a78d527e-dc6e-518f-ad6e-20beb5b60643/a78d527e-dc6e-518f-ad6e-20beb5b60643_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 185912,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/59096750-d732-4a04-93b4-5b26681153f6_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a78d527e-dc6e-518f-ad6e-20beb5b60643/a78d527e-dc6e-518f-ad6e-20beb5b60643_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 185912,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/59096750-d732-4a04-93b4-5b26681153f6_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a78d527e-dc6e-518f-ad6e-20beb5b60643/a78d527e-dc6e-518f-ad6e-20beb5b60643_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 243608,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/59096750-d732-4a04-93b4-5b26681153f6_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a78d527e-dc6e-518f-ad6e-20beb5b60643/a78d527e-dc6e-518f-ad6e-20beb5b60643_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 165022,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/59096750-d732-4a04-93b4-5b26681153f6_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a78d527e-dc6e-518f-ad6e-20beb5b60643/a78d527e-dc6e-518f-ad6e-20beb5b60643_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 180030,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/59096750-d732-4a04-93b4-5b26681153f6_5.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a78d527e-dc6e-518f-ad6e-20beb5b60643/a78d527e-dc6e-518f-ad6e-20beb5b60643_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 189626,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/59096750-d732-4a04-93b4-5b26681153f6_4.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a78d527e-dc6e-518f-ad6e-20beb5b60643/a78d527e-dc6e-518f-ad6e-20beb5b60643_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 179466,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/59096750-d732-4a04-93b4-5b26681153f6_11.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a78d527e-dc6e-518f-ad6e-20beb5b60643/a78d527e-dc6e-518f-ad6e-20beb5b60643_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 187905,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/59096750-d732-4a04-93b4-5b26681153f6_10.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a78d527e-dc6e-518f-ad6e-20beb5b60643/a78d527e-dc6e-518f-ad6e-20beb5b60643_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 193732,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/59096750-d732-4a04-93b4-5b26681153f6_9.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a78d527e-dc6e-518f-ad6e-20beb5b60643/a78d527e-dc6e-518f-ad6e-20beb5b60643_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 269674,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/59096750-d732-4a04-93b4-5b26681153f6_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a78d527e-dc6e-518f-ad6e-20beb5b60643/a78d527e-dc6e-518f-ad6e-20beb5b60643_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 248288,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/59096750-d732-4a04-93b4-5b26681153f6_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a78d527e-dc6e-518f-ad6e-20beb5b60643/a78d527e-dc6e-518f-ad6e-20beb5b60643_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 259097,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/59096750-d732-4a04-93b4-5b26681153f6_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a78d527e-dc6e-518f-ad6e-20beb5b60643/a78d527e-dc6e-518f-ad6e-20beb5b60643_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 251654,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/59096750-d732-4a04-93b4-5b26681153f6_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a78d527e-dc6e-518f-ad6e-20beb5b60643/a78d527e-dc6e-518f-ad6e-20beb5b60643_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 357279,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3739898-4000232-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a78d527e-dc6e-518f-ad6e-20beb5b60643/a78d527e-dc6e-518f-ad6e-20beb5b60643_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108429,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3739898-4000232-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a78d527e-dc6e-518f-ad6e-20beb5b60643/a78d527e-dc6e-518f-ad6e-20beb5b60643_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 428132,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3739898-4000232-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a78d527e-dc6e-518f-ad6e-20beb5b60643/a78d527e-dc6e-518f-ad6e-20beb5b60643_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 360872,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3739898-4000232-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a78d527e-dc6e-518f-ad6e-20beb5b60643/a78d527e-dc6e-518f-ad6e-20beb5b60643_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 325268,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3739898-4000232-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a78d527e-dc6e-518f-ad6e-20beb5b60643/a78d527e-dc6e-518f-ad6e-20beb5b60643_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 195176,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3739898-4000232-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a78d527e-dc6e-518f-ad6e-20beb5b60643/a78d527e-dc6e-518f-ad6e-20beb5b60643_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 279318,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3739898-4000232-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-31',
 'seller_name': 'Novuna Vehicle Solutions',
 'title': 'AUDI A3 30 TFSI Technik 5dr',
 'transmission': 'manual',
 'trim': '30 TFSI Technik 5dr',
 'year': 2021}
2025-12-04 10:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273739898%27 HTTP/1.1" 200 None
2025-12-04 10:06:53 [manheim.gb] INFO: Saving data for 3739898: {'created_time': 1764842813.308393, 'last_price_update_time': 1764842813.308404, 'auction_closing_time': 1765184400.0}
2025-12-04 10:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3739898') HTTP/1.1" 204 0
2025-12-04 10:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003694568-01970392-005.pdf> (referer: None)
2025-12-04 10:06:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd009810>
2025-12-04 10:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:06:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_941069ff-ef30-5bba-82bd-388d3cb54f16/941069ff-ef30-5bba-82bd-388d3cb54f16_image_15.jpg HTTP/1.1" 201 0
2025-12-04 10:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1966868-4007672-1001.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1966868-4007672-1001.jpg saved to cache
2025-12-04 10:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 941069ff-ef30-5bba-82bd-388d3cb54f16
2025-12-04 10:06:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd81350>
2025-12-04 10:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:06:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_941069ff-ef30-5bba-82bd-388d3cb54f16/941069ff-ef30-5bba-82bd-388d3cb54f16_image_16.jpg HTTP/1.1" 201 0
2025-12-04 10:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1966868-4007672-1002.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1966868-4007672-1002.jpg saved to cache
2025-12-04 10:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 941069ff-ef30-5bba-82bd-388d3cb54f16
2025-12-04 10:06:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc53ff50>
2025-12-04 10:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:06:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_941069ff-ef30-5bba-82bd-388d3cb54f16/941069ff-ef30-5bba-82bd-388d3cb54f16_image_19.jpg HTTP/1.1" 201 0
2025-12-04 10:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1966868-4007672-1005.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1966868-4007672-1005.jpg saved to cache
2025-12-04 10:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 941069ff-ef30-5bba-82bd-388d3cb54f16
2025-12-04 10:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3695980-3843088-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3695980-3843088-1000.jpg not downloaded yet
2025-12-04 10:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8e337748-4139-4d5b-bebe-205362a916f0_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003695980-01857253-003.pdf)
2025-12-04 10:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8e337748-4139-4d5b-bebe-205362a916f0_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003695980-01857253-003.pdf)
2025-12-04 10:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8e337748-4139-4d5b-bebe-205362a916f0_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003695980-01857253-003.pdf)
2025-12-04 10:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/79d3f9d2-f35f-4d29-ae30-54140900dd77_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001966868-01991002-001.pdf)
2025-12-04 10:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8e337748-4139-4d5b-bebe-205362a916f0_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003695980-01857253-003.pdf)
2025-12-04 10:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3695980-3843088-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3695980-3843088-1001.jpg not downloaded yet
2025-12-04 10:06:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc69d5d0>
2025-12-04 10:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:06:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d3c4703-d25f-5d38-acb2-8bc444613975/5d3c4703-d25f-5d38-acb2-8bc444613975_expert_report_file_3cdfbceb-4e33-4af0-b730-a07ca232760e.pdf HTTP/1.1" 201 0
2025-12-04 10:06:54 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 5d3c4703-d25f-5d38-acb2-8bc444613975
2025-12-04 10:06:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5d3c4703-d25f-5d38-acb2-8bc444613975, skipping ID generation
2025-12-04 10:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 18 photos for item 5d3c4703-d25f-5d38-acb2-8bc444613975
2025-12-04 10:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F64bf3626-007f-4c2f-84d4-d24894a4bb89_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/64bf3626-007f-4c2f-84d4-d24894a4bb89_ext_7.jpg already downloaded
2025-12-04 10:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F64bf3626-007f-4c2f-84d4-d24894a4bb89_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/64bf3626-007f-4c2f-84d4-d24894a4bb89_ext_7.jpg already downloaded
2025-12-04 10:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F64bf3626-007f-4c2f-84d4-d24894a4bb89_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/64bf3626-007f-4c2f-84d4-d24894a4bb89_ext_6.jpg already downloaded
2025-12-04 10:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F64bf3626-007f-4c2f-84d4-d24894a4bb89_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/64bf3626-007f-4c2f-84d4-d24894a4bb89_ext_1.jpg already downloaded
2025-12-04 10:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F64bf3626-007f-4c2f-84d4-d24894a4bb89_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/64bf3626-007f-4c2f-84d4-d24894a4bb89_5.jpg already downloaded
2025-12-04 10:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F64bf3626-007f-4c2f-84d4-d24894a4bb89_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/64bf3626-007f-4c2f-84d4-d24894a4bb89_4.jpg already downloaded
2025-12-04 10:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F64bf3626-007f-4c2f-84d4-d24894a4bb89_11.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/64bf3626-007f-4c2f-84d4-d24894a4bb89_11.jpg already downloaded
2025-12-04 10:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F64bf3626-007f-4c2f-84d4-d24894a4bb89_10.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/64bf3626-007f-4c2f-84d4-d24894a4bb89_10.jpg already downloaded
2025-12-04 10:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F64bf3626-007f-4c2f-84d4-d24894a4bb89_9.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/64bf3626-007f-4c2f-84d4-d24894a4bb89_9.jpg already downloaded
2025-12-04 10:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F64bf3626-007f-4c2f-84d4-d24894a4bb89_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/64bf3626-007f-4c2f-84d4-d24894a4bb89_ext_2.jpg already downloaded
2025-12-04 10:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F64bf3626-007f-4c2f-84d4-d24894a4bb89_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/64bf3626-007f-4c2f-84d4-d24894a4bb89_ext_5.jpg already downloaded
2025-12-04 10:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F64bf3626-007f-4c2f-84d4-d24894a4bb89_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/64bf3626-007f-4c2f-84d4-d24894a4bb89_ext_3.jpg already downloaded
2025-12-04 10:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F64bf3626-007f-4c2f-84d4-d24894a4bb89_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/64bf3626-007f-4c2f-84d4-d24894a4bb89_ext_4.jpg already downloaded
2025-12-04 10:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3694568-3984450-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3694568-3984450-13.jpg not downloaded yet
2025-12-04 10:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8e337748-4139-4d5b-bebe-205362a916f0_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003695980-01857253-003.pdf)
2025-12-04 10:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3695980-3843088-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3695980-3843088-1002.jpg not downloaded yet
2025-12-04 10:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3694568-3984450-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3694568-3984450-1000.jpg not downloaded yet
2025-12-04 10:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3695980-3843088-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3695980-3843088-1003.jpg not downloaded yet
2025-12-04 10:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3694568-3984450-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3694568-3984450-1001.jpg not downloaded yet
2025-12-04 10:06:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc72d110>
2025-12-04 10:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:06:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53095d01-1a66-5767-9416-77f431c3c7f5/53095d01-1a66-5767-9416-77f431c3c7f5_image_4.jpg HTTP/1.1" 201 0
2025-12-04 10:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8e337748-4139-4d5b-bebe-205362a916f0_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8e337748-4139-4d5b-bebe-205362a916f0_5.jpg saved to cache
2025-12-04 10:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 53095d01-1a66-5767-9416-77f431c3c7f5
2025-12-04 10:06:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccfbbc10>
2025-12-04 10:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:06:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53095d01-1a66-5767-9416-77f431c3c7f5/53095d01-1a66-5767-9416-77f431c3c7f5_image_5.jpg HTTP/1.1" 201 0
2025-12-04 10:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8e337748-4139-4d5b-bebe-205362a916f0_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8e337748-4139-4d5b-bebe-205362a916f0_4.jpg saved to cache
2025-12-04 10:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 53095d01-1a66-5767-9416-77f431c3c7f5
2025-12-04 10:06:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce91b10>
2025-12-04 10:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:06:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53095d01-1a66-5767-9416-77f431c3c7f5/53095d01-1a66-5767-9416-77f431c3c7f5_image_6.jpg HTTP/1.1" 201 0
2025-12-04 10:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8e337748-4139-4d5b-bebe-205362a916f0_11.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8e337748-4139-4d5b-bebe-205362a916f0_11.jpg saved to cache
2025-12-04 10:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 53095d01-1a66-5767-9416-77f431c3c7f5
2025-12-04 10:06:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccfa86d0>
2025-12-04 10:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:06:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_941069ff-ef30-5bba-82bd-388d3cb54f16/941069ff-ef30-5bba-82bd-388d3cb54f16_image_12.jpg HTTP/1.1" 201 0
2025-12-04 10:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F79d3f9d2-f35f-4d29-ae30-54140900dd77_ext_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/79d3f9d2-f35f-4d29-ae30-54140900dd77_ext_4.jpg saved to cache
2025-12-04 10:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 941069ff-ef30-5bba-82bd-388d3cb54f16
2025-12-04 10:06:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf33d50>
2025-12-04 10:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:06:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53095d01-1a66-5767-9416-77f431c3c7f5/53095d01-1a66-5767-9416-77f431c3c7f5_image_3.jpg HTTP/1.1" 201 0
2025-12-04 10:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8e337748-4139-4d5b-bebe-205362a916f0_ext_1.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8e337748-4139-4d5b-bebe-205362a916f0_ext_1.jpg saved to cache
2025-12-04 10:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 53095d01-1a66-5767-9416-77f431c3c7f5
2025-12-04 10:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3695980-3843088-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3695980-3843088-1004.jpg not downloaded yet
2025-12-04 10:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3694568-3984450-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3694568-3984450-1002.jpg not downloaded yet
2025-12-04 10:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3695980-3843088-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003695980-01857253-003.pdf)
2025-12-04 10:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3695980-3843088-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3695980-3843088-1005.jpg not downloaded yet
2025-12-04 10:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3694568-3984450-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3694568-3984450-1003.jpg not downloaded yet
2025-12-04 10:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8e337748-4139-4d5b-bebe-205362a916f0_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003695980-01857253-003.pdf)
2025-12-04 10:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8e337748-4139-4d5b-bebe-205362a916f0_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003695980-01857253-003.pdf)
2025-12-04 10:06:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccde9d50>
2025-12-04 10:06:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:06:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53095d01-1a66-5767-9416-77f431c3c7f5/53095d01-1a66-5767-9416-77f431c3c7f5_image_2.jpg HTTP/1.1" 201 0
2025-12-04 10:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8e337748-4139-4d5b-bebe-205362a916f0_ext_6.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8e337748-4139-4d5b-bebe-205362a916f0_ext_6.jpg saved to cache
2025-12-04 10:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 53095d01-1a66-5767-9416-77f431c3c7f5
2025-12-04 10:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8e337748-4139-4d5b-bebe-205362a916f0_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003695980-01857253-003.pdf)
2025-12-04 10:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8e337748-4139-4d5b-bebe-205362a916f0_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003695980-01857253-003.pdf)
2025-12-04 10:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3695980-3843088-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003695980-01857253-003.pdf)
2025-12-04 10:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3694568-3984450-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003694568-01970392-005.pdf)
2025-12-04 10:06:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc601e50>
2025-12-04 10:06:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:06:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53095d01-1a66-5767-9416-77f431c3c7f5/53095d01-1a66-5767-9416-77f431c3c7f5_image_13.jpg HTTP/1.1" 201 0
2025-12-04 10:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3695980-3843088-13.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3695980-3843088-13.jpg saved to cache
2025-12-04 10:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 53095d01-1a66-5767-9416-77f431c3c7f5
2025-12-04 10:06:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cccab450>
2025-12-04 10:06:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:06:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53095d01-1a66-5767-9416-77f431c3c7f5/53095d01-1a66-5767-9416-77f431c3c7f5_image_11.jpg HTTP/1.1" 201 0
2025-12-04 10:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8e337748-4139-4d5b-bebe-205362a916f0_ext_3.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8e337748-4139-4d5b-bebe-205362a916f0_ext_3.jpg saved to cache
2025-12-04 10:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 53095d01-1a66-5767-9416-77f431c3c7f5
2025-12-04 10:06:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6e37d0>
2025-12-04 10:06:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:06:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53095d01-1a66-5767-9416-77f431c3c7f5/53095d01-1a66-5767-9416-77f431c3c7f5_image_12.jpg HTTP/1.1" 201 0
2025-12-04 10:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8e337748-4139-4d5b-bebe-205362a916f0_ext_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8e337748-4139-4d5b-bebe-205362a916f0_ext_4.jpg saved to cache
2025-12-04 10:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 53095d01-1a66-5767-9416-77f431c3c7f5
2025-12-04 10:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3694568-3984450-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003694568-01970392-005.pdf)
2025-12-04 10:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3695980-3843088-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003695980-01857253-003.pdf)
2025-12-04 10:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3694568-3984450-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003694568-01970392-005.pdf)
2025-12-04 10:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3694568-3984450-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003694568-01970392-005.pdf)
2025-12-04 10:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3695980-3843088-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003695980-01857253-003.pdf)
2025-12-04 10:06:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd063810>
2025-12-04 10:06:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:06:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53095d01-1a66-5767-9416-77f431c3c7f5/53095d01-1a66-5767-9416-77f431c3c7f5_image_10.jpg HTTP/1.1" 201 0
2025-12-04 10:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8e337748-4139-4d5b-bebe-205362a916f0_ext_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8e337748-4139-4d5b-bebe-205362a916f0_ext_5.jpg saved to cache
2025-12-04 10:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 53095d01-1a66-5767-9416-77f431c3c7f5
2025-12-04 10:06:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc699b90>
2025-12-04 10:06:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:06:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53095d01-1a66-5767-9416-77f431c3c7f5/53095d01-1a66-5767-9416-77f431c3c7f5_image_9.jpg HTTP/1.1" 201 0
2025-12-04 10:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8e337748-4139-4d5b-bebe-205362a916f0_ext_2.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8e337748-4139-4d5b-bebe-205362a916f0_ext_2.jpg saved to cache
2025-12-04 10:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 53095d01-1a66-5767-9416-77f431c3c7f5
2025-12-04 10:06:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc54d1d0>
2025-12-04 10:06:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:06:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53095d01-1a66-5767-9416-77f431c3c7f5/53095d01-1a66-5767-9416-77f431c3c7f5_image_14.jpg HTTP/1.1" 201 0
2025-12-04 10:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3695980-3843088-1000.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3695980-3843088-1000.jpg saved to cache
2025-12-04 10:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 53095d01-1a66-5767-9416-77f431c3c7f5
2025-12-04 10:06:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6e4590>
2025-12-04 10:06:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:06:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d3c4703-d25f-5d38-acb2-8bc444613975/5d3c4703-d25f-5d38-acb2-8bc444613975_image_13.jpg HTTP/1.1" 201 0
2025-12-04 10:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3694568-3984450-13.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3694568-3984450-13.jpg saved to cache
2025-12-04 10:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 5d3c4703-d25f-5d38-acb2-8bc444613975
2025-12-04 10:06:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3694568-3984450-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003694568-01970392-005.pdf)
2025-12-04 10:06:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3695980-3843088-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003695980-01857253-003.pdf)
2025-12-04 10:06:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003719784-01988521-002.pdf> (referer: None)
2025-12-04 10:06:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 10:06:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6d87d0>
2025-12-04 10:06:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:06:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d3c4703-d25f-5d38-acb2-8bc444613975/5d3c4703-d25f-5d38-acb2-8bc444613975_image_16.jpg HTTP/1.1" 201 0
2025-12-04 10:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3694568-3984450-1002.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3694568-3984450-1002.jpg saved to cache
2025-12-04 10:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 5d3c4703-d25f-5d38-acb2-8bc444613975
2025-12-04 10:06:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf08b10>
2025-12-04 10:06:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:06:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53095d01-1a66-5767-9416-77f431c3c7f5/53095d01-1a66-5767-9416-77f431c3c7f5_image_19.jpg HTTP/1.1" 201 0
2025-12-04 10:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3695980-3843088-1005.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3695980-3843088-1005.jpg saved to cache
2025-12-04 10:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 53095d01-1a66-5767-9416-77f431c3c7f5
2025-12-04 10:06:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cccd36d0>
2025-12-04 10:06:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:06:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d3c4703-d25f-5d38-acb2-8bc444613975/5d3c4703-d25f-5d38-acb2-8bc444613975_image_15.jpg HTTP/1.1" 201 0
2025-12-04 10:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3694568-3984450-1001.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3694568-3984450-1001.jpg saved to cache
2025-12-04 10:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 5d3c4703-d25f-5d38-acb2-8bc444613975
2025-12-04 10:06:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccdf5950>
2025-12-04 10:06:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:06:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d3c4703-d25f-5d38-acb2-8bc444613975/5d3c4703-d25f-5d38-acb2-8bc444613975_image_17.jpg HTTP/1.1" 201 0
2025-12-04 10:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3694568-3984450-1003.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3694568-3984450-1003.jpg saved to cache
2025-12-04 10:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 5d3c4703-d25f-5d38-acb2-8bc444613975
2025-12-04 10:06:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5c95d0>
2025-12-04 10:06:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:06:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53095d01-1a66-5767-9416-77f431c3c7f5/53095d01-1a66-5767-9416-77f431c3c7f5_image_17.jpg HTTP/1.1" 201 0
2025-12-04 10:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3695980-3843088-1003.jpg') HTTP/1.1" 204 0
2025-12-04 10:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3695980-3843088-1003.jpg saved to cache
2025-12-04 10:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 53095d01-1a66-5767-9416-77f431c3c7f5
2025-12-04 10:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3695980-3843088-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003695980-01857253-003.pdf)
2025-12-04 10:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8e337748-4139-4d5b-bebe-205362a916f0_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003695980-01857253-003.pdf)
2025-12-04 10:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8e337748-4139-4d5b-bebe-205362a916f0_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003695980-01857253-003.pdf)
2025-12-04 10:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/79d3f9d2-f35f-4d29-ae30-54140900dd77_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001966868-01991002-001.pdf)
2025-12-04 10:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/79d3f9d2-f35f-4d29-ae30-54140900dd77_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001966868-01991002-001.pdf)
2025-12-04 10:06:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:06:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:06:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:06:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd9be50>
2025-12-04 10:06:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:06:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:06:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:06:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:06:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d3c4703-d25f-5d38-acb2-8bc444613975/5d3c4703-d25f-5d38-acb2-8bc444613975_image_14.jpg HTTP/1.1" 201 0
2025-12-04 10:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3694568-3984450-1000.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3694568-3984450-1000.jpg saved to cache
2025-12-04 10:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 5d3c4703-d25f-5d38-acb2-8bc444613975
2025-12-04 10:07:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5d3c4703-d25f-5d38-acb2-8bc444613975, skipping ID generation
2025-12-04 10:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 5d3c4703-d25f-5d38-acb2-8bc444613975 from tracking dictionaries
2025-12-04 10:07:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5d3c4703-d25f-5d38-acb2-8bc444613975 sending to next pipeline
2025-12-04 10:07:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 5d3c4703-d25f-5d38-acb2-8bc444613975, identifier: 3694568
2025-12-04 10:07:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf84250>
2025-12-04 10:07:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:07:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53095d01-1a66-5767-9416-77f431c3c7f5/53095d01-1a66-5767-9416-77f431c3c7f5_image_18.jpg HTTP/1.1" 201 0
2025-12-04 10:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3695980-3843088-1004.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3695980-3843088-1004.jpg saved to cache
2025-12-04 10:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 53095d01-1a66-5767-9416-77f431c3c7f5
2025-12-04 10:07:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cccc7490>
2025-12-04 10:07:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:07:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_836f12a0-cbbe-5a79-8594-40f844ef76d6/836f12a0-cbbe-5a79-8594-40f844ef76d6_expert_report_file_f5cf00f7-cd85-4825-bb70-3d32a54e8bee.pdf HTTP/1.1" 201 0
2025-12-04 10:07:01 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 836f12a0-cbbe-5a79-8594-40f844ef76d6
2025-12-04 10:07:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 836f12a0-cbbe-5a79-8594-40f844ef76d6, skipping ID generation
2025-12-04 10:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 836f12a0-cbbe-5a79-8594-40f844ef76d6
2025-12-04 10:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1ff2cf1c-9853-4add-86ed-c05f0b696ce0_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1ff2cf1c-9853-4add-86ed-c05f0b696ce0_ext_7.jpg not downloaded yet
2025-12-04 10:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3695980-3843088-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003695980-01857253-003.pdf)
2025-12-04 10:07:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 5d3c4703-d25f-5d38-acb2-8bc444613975 with identifier: 3694568
2025-12-04 10:07:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-04 10:07:01 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Grey+%2F+Silver HTTP/1.1" 200 None
2025-12-04 10:07:01 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-04 10:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-04 10:07:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 5d3c4703-d25f-5d38-acb2-8bc444613975 with identifier: 3694568
2025-12-04 10:07:01 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 5d3c4703-d25f-5d38-acb2-8bc444613975 with identifier: 3694568 to the API
2025-12-04 10:07:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 10:07:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 10:07:01 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/insp-0001-3694568-3984450-1000.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d3c4703-d25f-5d38-acb2-8bc444613975/5d3c4703-d25f-5d38-acb2-8bc444613975_expert_report_file_3cdfbceb-4e33-4af0-b730-a07ca232760e.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003694568-01970392-005.pdf',
 'color': 'Grey',
 'currency': 'GBP',
 'engine': '1.5L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '5d3c4703-d25f-5d38-acb2-8bc444613975',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'DMZ1403',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VAUXHALL/ASTRA?id=3694568',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'VAUXHALL',
 'model': 'ASTRA',
 'odometer': 7953,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 18,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d3c4703-d25f-5d38-acb2-8bc444613975/5d3c4703-d25f-5d38-acb2-8bc444613975_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 204703,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/64bf3626-007f-4c2f-84d4-d24894a4bb89_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d3c4703-d25f-5d38-acb2-8bc444613975/5d3c4703-d25f-5d38-acb2-8bc444613975_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 204703,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/64bf3626-007f-4c2f-84d4-d24894a4bb89_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d3c4703-d25f-5d38-acb2-8bc444613975/5d3c4703-d25f-5d38-acb2-8bc444613975_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 236804,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/64bf3626-007f-4c2f-84d4-d24894a4bb89_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d3c4703-d25f-5d38-acb2-8bc444613975/5d3c4703-d25f-5d38-acb2-8bc444613975_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 156495,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/64bf3626-007f-4c2f-84d4-d24894a4bb89_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d3c4703-d25f-5d38-acb2-8bc444613975/5d3c4703-d25f-5d38-acb2-8bc444613975_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 196590,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/64bf3626-007f-4c2f-84d4-d24894a4bb89_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d3c4703-d25f-5d38-acb2-8bc444613975/5d3c4703-d25f-5d38-acb2-8bc444613975_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 190146,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/64bf3626-007f-4c2f-84d4-d24894a4bb89_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d3c4703-d25f-5d38-acb2-8bc444613975/5d3c4703-d25f-5d38-acb2-8bc444613975_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 198971,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/64bf3626-007f-4c2f-84d4-d24894a4bb89_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d3c4703-d25f-5d38-acb2-8bc444613975/5d3c4703-d25f-5d38-acb2-8bc444613975_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 200732,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/64bf3626-007f-4c2f-84d4-d24894a4bb89_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d3c4703-d25f-5d38-acb2-8bc444613975/5d3c4703-d25f-5d38-acb2-8bc444613975_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 214958,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/64bf3626-007f-4c2f-84d4-d24894a4bb89_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d3c4703-d25f-5d38-acb2-8bc444613975/5d3c4703-d25f-5d38-acb2-8bc444613975_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 280991,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/64bf3626-007f-4c2f-84d4-d24894a4bb89_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d3c4703-d25f-5d38-acb2-8bc444613975/5d3c4703-d25f-5d38-acb2-8bc444613975_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 258974,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/64bf3626-007f-4c2f-84d4-d24894a4bb89_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d3c4703-d25f-5d38-acb2-8bc444613975/5d3c4703-d25f-5d38-acb2-8bc444613975_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 239805,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/64bf3626-007f-4c2f-84d4-d24894a4bb89_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d3c4703-d25f-5d38-acb2-8bc444613975/5d3c4703-d25f-5d38-acb2-8bc444613975_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 217033,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/64bf3626-007f-4c2f-84d4-d24894a4bb89_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d3c4703-d25f-5d38-acb2-8bc444613975/5d3c4703-d25f-5d38-acb2-8bc444613975_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 330873,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3694568-3984450-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d3c4703-d25f-5d38-acb2-8bc444613975/5d3c4703-d25f-5d38-acb2-8bc444613975_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 289935,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3694568-3984450-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d3c4703-d25f-5d38-acb2-8bc444613975/5d3c4703-d25f-5d38-acb2-8bc444613975_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 190065,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3694568-3984450-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d3c4703-d25f-5d38-acb2-8bc444613975/5d3c4703-d25f-5d38-acb2-8bc444613975_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 278457,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3694568-3984450-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d3c4703-d25f-5d38-acb2-8bc444613975/5d3c4703-d25f-5d38-acb2-8bc444613975_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 201933,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3694568-3984450-1003.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-01-30',
 'seller_name': 'Vauxhall Motors Limited',
 'title': 'VAUXHALL ASTRA 1.5 Turbo D GS 5dr',
 'transmission': 'manual',
 'trim': '1.5 Turbo D GS 5dr',
 'year': 2024}
2025-12-04 10:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273694568%27 HTTP/1.1" 200 None
2025-12-04 10:07:01 [manheim.gb] INFO: Saving data for 3694568: {'created_time': 1764842821.731057, 'last_price_update_time': 1764842821.731067, 'auction_closing_time': 1765270800.0}
2025-12-04 10:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3694568') HTTP/1.1" 204 0
2025-12-04 10:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1ff2cf1c-9853-4add-86ed-c05f0b696ce0_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1ff2cf1c-9853-4add-86ed-c05f0b696ce0_ext_7.jpg not downloaded yet
2025-12-04 10:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1ff2cf1c-9853-4add-86ed-c05f0b696ce0_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1ff2cf1c-9853-4add-86ed-c05f0b696ce0_ext_6.jpg not downloaded yet
2025-12-04 10:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/79d3f9d2-f35f-4d29-ae30-54140900dd77_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001966868-01991002-001.pdf)
2025-12-04 10:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/79d3f9d2-f35f-4d29-ae30-54140900dd77_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001966868-01991002-001.pdf)
2025-12-04 10:07:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf5bb90>
2025-12-04 10:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:07:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53095d01-1a66-5767-9416-77f431c3c7f5/53095d01-1a66-5767-9416-77f431c3c7f5_image_16.jpg HTTP/1.1" 201 0
2025-12-04 10:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3695980-3843088-1002.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3695980-3843088-1002.jpg saved to cache
2025-12-04 10:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 53095d01-1a66-5767-9416-77f431c3c7f5
2025-12-04 10:07:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccca6590>
2025-12-04 10:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:07:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53095d01-1a66-5767-9416-77f431c3c7f5/53095d01-1a66-5767-9416-77f431c3c7f5_image_7.jpg HTTP/1.1" 201 0
2025-12-04 10:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8e337748-4139-4d5b-bebe-205362a916f0_10.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8e337748-4139-4d5b-bebe-205362a916f0_10.jpg saved to cache
2025-12-04 10:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 53095d01-1a66-5767-9416-77f431c3c7f5
2025-12-04 10:07:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd0d9550>
2025-12-04 10:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:07:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53095d01-1a66-5767-9416-77f431c3c7f5/53095d01-1a66-5767-9416-77f431c3c7f5_image_8.jpg HTTP/1.1" 201 0
2025-12-04 10:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8e337748-4139-4d5b-bebe-205362a916f0_9.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8e337748-4139-4d5b-bebe-205362a916f0_9.jpg saved to cache
2025-12-04 10:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 53095d01-1a66-5767-9416-77f431c3c7f5
2025-12-04 10:07:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5c23d0>
2025-12-04 10:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 10:07:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_941069ff-ef30-5bba-82bd-388d3cb54f16/941069ff-ef30-5bba-82bd-388d3cb54f16_image_11.jpg HTTP/1.1" 201 0
2025-12-04 10:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F79d3f9d2-f35f-4d29-ae30-54140900dd77_ext_3.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/79d3f9d2-f35f-4d29-ae30-54140900dd77_ext_3.jpg saved to cache
2025-12-04 10:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 941069ff-ef30-5bba-82bd-388d3cb54f16
2025-12-04 10:07:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cccd8890>
2025-12-04 10:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 10:07:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_941069ff-ef30-5bba-82bd-388d3cb54f16/941069ff-ef30-5bba-82bd-388d3cb54f16_image_10.jpg HTTP/1.1" 201 0
2025-12-04 10:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F79d3f9d2-f35f-4d29-ae30-54140900dd77_ext_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/79d3f9d2-f35f-4d29-ae30-54140900dd77_ext_5.jpg saved to cache
2025-12-04 10:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 941069ff-ef30-5bba-82bd-388d3cb54f16
2025-12-04 10:07:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc544650>
2025-12-04 10:07:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:07:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53095d01-1a66-5767-9416-77f431c3c7f5/53095d01-1a66-5767-9416-77f431c3c7f5_image_15.jpg HTTP/1.1" 201 0
2025-12-04 10:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3695980-3843088-1001.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3695980-3843088-1001.jpg saved to cache
2025-12-04 10:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 53095d01-1a66-5767-9416-77f431c3c7f5
2025-12-04 10:07:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 53095d01-1a66-5767-9416-77f431c3c7f5, skipping ID generation
2025-12-04 10:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 53095d01-1a66-5767-9416-77f431c3c7f5 from tracking dictionaries
2025-12-04 10:07:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 53095d01-1a66-5767-9416-77f431c3c7f5 sending to next pipeline
2025-12-04 10:07:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 53095d01-1a66-5767-9416-77f431c3c7f5, identifier: 3695980
2025-12-04 10:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/79d3f9d2-f35f-4d29-ae30-54140900dd77_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001966868-01991002-001.pdf)
2025-12-04 10:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1ff2cf1c-9853-4add-86ed-c05f0b696ce0_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1ff2cf1c-9853-4add-86ed-c05f0b696ce0_ext_1.jpg not downloaded yet
2025-12-04 10:07:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 53095d01-1a66-5767-9416-77f431c3c7f5 with identifier: 3695980
2025-12-04 10:07:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 53095d01-1a66-5767-9416-77f431c3c7f5 with identifier: 3695980
2025-12-04 10:07:04 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 53095d01-1a66-5767-9416-77f431c3c7f5 with identifier: 3695980 to the API
2025-12-04 10:07:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 10:07:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 10:07:04 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/insp-0001-3695980-3843088-1001.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53095d01-1a66-5767-9416-77f431c3c7f5/53095d01-1a66-5767-9416-77f431c3c7f5_expert_report_file_e0c53b23-7ecf-4d6d-833e-e33a1e24550b.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003695980-01857253-003.pdf',
 'color': 'SILVER',
 'currency': 'GBP',
 'engine': '1.5L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '53095d01-1a66-5767-9416-77f431c3c7f5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'LF72MEK',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MG/MG3?id=3695980',
 'listing': 'auction',
 'location': 'Bristol',
 'make': 'MG',
 'model': 'MG3',
 'odometer': 35714,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 26,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53095d01-1a66-5767-9416-77f431c3c7f5/53095d01-1a66-5767-9416-77f431c3c7f5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 175364,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/8e337748-4139-4d5b-bebe-205362a916f0_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53095d01-1a66-5767-9416-77f431c3c7f5/53095d01-1a66-5767-9416-77f431c3c7f5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 175364,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/8e337748-4139-4d5b-bebe-205362a916f0_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53095d01-1a66-5767-9416-77f431c3c7f5/53095d01-1a66-5767-9416-77f431c3c7f5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 261975,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/8e337748-4139-4d5b-bebe-205362a916f0_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53095d01-1a66-5767-9416-77f431c3c7f5/53095d01-1a66-5767-9416-77f431c3c7f5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 230894,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/8e337748-4139-4d5b-bebe-205362a916f0_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53095d01-1a66-5767-9416-77f431c3c7f5/53095d01-1a66-5767-9416-77f431c3c7f5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 165021,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/8e337748-4139-4d5b-bebe-205362a916f0_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53095d01-1a66-5767-9416-77f431c3c7f5/53095d01-1a66-5767-9416-77f431c3c7f5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 151570,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/8e337748-4139-4d5b-bebe-205362a916f0_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53095d01-1a66-5767-9416-77f431c3c7f5/53095d01-1a66-5767-9416-77f431c3c7f5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 158324,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/8e337748-4139-4d5b-bebe-205362a916f0_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53095d01-1a66-5767-9416-77f431c3c7f5/53095d01-1a66-5767-9416-77f431c3c7f5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 148565,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/8e337748-4139-4d5b-bebe-205362a916f0_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53095d01-1a66-5767-9416-77f431c3c7f5/53095d01-1a66-5767-9416-77f431c3c7f5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 153277,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/8e337748-4139-4d5b-bebe-205362a916f0_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53095d01-1a66-5767-9416-77f431c3c7f5/53095d01-1a66-5767-9416-77f431c3c7f5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 301746,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/8e337748-4139-4d5b-bebe-205362a916f0_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53095d01-1a66-5767-9416-77f431c3c7f5/53095d01-1a66-5767-9416-77f431c3c7f5_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 278951,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/8e337748-4139-4d5b-bebe-205362a916f0_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53095d01-1a66-5767-9416-77f431c3c7f5/53095d01-1a66-5767-9416-77f431c3c7f5_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 218702,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/8e337748-4139-4d5b-bebe-205362a916f0_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53095d01-1a66-5767-9416-77f431c3c7f5/53095d01-1a66-5767-9416-77f431c3c7f5_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 235050,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/8e337748-4139-4d5b-bebe-205362a916f0_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53095d01-1a66-5767-9416-77f431c3c7f5/53095d01-1a66-5767-9416-77f431c3c7f5_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 328843,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3695980-3843088-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53095d01-1a66-5767-9416-77f431c3c7f5/53095d01-1a66-5767-9416-77f431c3c7f5_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 303216,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3695980-3843088-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53095d01-1a66-5767-9416-77f431c3c7f5/53095d01-1a66-5767-9416-77f431c3c7f5_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 284800,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3695980-3843088-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53095d01-1a66-5767-9416-77f431c3c7f5/53095d01-1a66-5767-9416-77f431c3c7f5_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 308980,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3695980-3843088-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53095d01-1a66-5767-9416-77f431c3c7f5/53095d01-1a66-5767-9416-77f431c3c7f5_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 260080,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3695980-3843088-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53095d01-1a66-5767-9416-77f431c3c7f5/53095d01-1a66-5767-9416-77f431c3c7f5_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 322353,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3695980-3843088-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53095d01-1a66-5767-9416-77f431c3c7f5/53095d01-1a66-5767-9416-77f431c3c7f5_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 157792,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3695980-3843088-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-01',
 'seller_name': 'Leasys',
 'title': 'MG MG3 1.5 VTi-TECH Exclusive 5dr [Navigation]',
 'transmission': 'manual',
 'trim': '1.5 VTi-TECH Exclusive 5dr [Navigation]',
 'year': 2023}
2025-12-04 10:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273695980%27 HTTP/1.1" 200 None
2025-12-04 10:07:04 [manheim.gb] INFO: Saving data for 3695980: {'created_time': 1764842824.377449, 'last_price_update_time': 1764842824.37746, 'auction_closing_time': 1765270800.0}
2025-12-04 10:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3695980') HTTP/1.1" 204 0
2025-12-04 10:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1ff2cf1c-9853-4add-86ed-c05f0b696ce0_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1ff2cf1c-9853-4add-86ed-c05f0b696ce0_5.jpg not downloaded yet
2025-12-04 10:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VAUXHALL/ASTRA?id=3693298&returnUrl=%2Fsearch%3FPage%3D4%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233693298&indx=343> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 10:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1ff2cf1c-9853-4add-86ed-c05f0b696ce0_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003719784-01988521-002.pdf)
2025-12-04 10:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1ff2cf1c-9853-4add-86ed-c05f0b696ce0_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1ff2cf1c-9853-4add-86ed-c05f0b696ce0_4.jpg not downloaded yet
2025-12-04 10:07:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 10:07:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc68f3d0>
2025-12-04 10:07:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:07:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_941069ff-ef30-5bba-82bd-388d3cb54f16/941069ff-ef30-5bba-82bd-388d3cb54f16_image_9.jpg HTTP/1.1" 201 0
2025-12-04 10:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F79d3f9d2-f35f-4d29-ae30-54140900dd77_ext_2.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/79d3f9d2-f35f-4d29-ae30-54140900dd77_ext_2.jpg saved to cache
2025-12-04 10:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 941069ff-ef30-5bba-82bd-388d3cb54f16
2025-12-04 10:07:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccce7e10>
2025-12-04 10:07:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:07:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_941069ff-ef30-5bba-82bd-388d3cb54f16/941069ff-ef30-5bba-82bd-388d3cb54f16_image_7.jpg HTTP/1.1" 201 0
2025-12-04 10:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F79d3f9d2-f35f-4d29-ae30-54140900dd77_10.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/79d3f9d2-f35f-4d29-ae30-54140900dd77_10.jpg saved to cache
2025-12-04 10:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 941069ff-ef30-5bba-82bd-388d3cb54f16
2025-12-04 10:07:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6d6d10>
2025-12-04 10:07:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:07:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_941069ff-ef30-5bba-82bd-388d3cb54f16/941069ff-ef30-5bba-82bd-388d3cb54f16_image_8.jpg HTTP/1.1" 201 0
2025-12-04 10:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F79d3f9d2-f35f-4d29-ae30-54140900dd77_9.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/79d3f9d2-f35f-4d29-ae30-54140900dd77_9.jpg saved to cache
2025-12-04 10:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 941069ff-ef30-5bba-82bd-388d3cb54f16
2025-12-04 10:07:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1ff2cf1c-9853-4add-86ed-c05f0b696ce0_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003719784-01988521-002.pdf)
2025-12-04 10:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1ff2cf1c-9853-4add-86ed-c05f0b696ce0_11.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1ff2cf1c-9853-4add-86ed-c05f0b696ce0_11.jpg not downloaded yet
2025-12-04 10:07:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=3692062&returnUrl=%2Fsearch%3FPage%3D4%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233692062&indx=342> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 10:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1ff2cf1c-9853-4add-86ed-c05f0b696ce0_10.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1ff2cf1c-9853-4add-86ed-c05f0b696ce0_10.jpg not downloaded yet
2025-12-04 10:07:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 10:07:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1ff2cf1c-9853-4add-86ed-c05f0b696ce0_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003719784-01988521-002.pdf)
2025-12-04 10:07:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df58e7f8-61e7-56dd-9423-3b35c4acd52f with identifier: 3693298
2025-12-04 10:07:05 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item df58e7f8-61e7-56dd-9423-3b35c4acd52f
2025-12-04 10:07:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc54e550>
2025-12-04 10:07:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:07:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_836f12a0-cbbe-5a79-8594-40f844ef76d6/836f12a0-cbbe-5a79-8594-40f844ef76d6_image_0.jpg HTTP/1.1" 201 0
2025-12-04 10:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1ff2cf1c-9853-4add-86ed-c05f0b696ce0_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1ff2cf1c-9853-4add-86ed-c05f0b696ce0_ext_7.jpg saved to cache
2025-12-04 10:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 836f12a0-cbbe-5a79-8594-40f844ef76d6
2025-12-04 10:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1ff2cf1c-9853-4add-86ed-c05f0b696ce0_9.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1ff2cf1c-9853-4add-86ed-c05f0b696ce0_9.jpg not downloaded yet
2025-12-04 10:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1ff2cf1c-9853-4add-86ed-c05f0b696ce0_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1ff2cf1c-9853-4add-86ed-c05f0b696ce0_ext_2.jpg not downloaded yet
2025-12-04 10:07:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003696287-01975311-004.pdf> (referer: None)
2025-12-04 10:07:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1ff2cf1c-9853-4add-86ed-c05f0b696ce0_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003719784-01988521-002.pdf)
2025-12-04 10:07:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1ff2cf1c-9853-4add-86ed-c05f0b696ce0_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003719784-01988521-002.pdf)
2025-12-04 10:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1ff2cf1c-9853-4add-86ed-c05f0b696ce0_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1ff2cf1c-9853-4add-86ed-c05f0b696ce0_ext_5.jpg not downloaded yet
2025-12-04 10:07:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6d6050>
2025-12-04 10:07:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 10:07:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_836f12a0-cbbe-5a79-8594-40f844ef76d6/836f12a0-cbbe-5a79-8594-40f844ef76d6_image_1.jpg HTTP/1.1" 201 0
2025-12-04 10:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1ff2cf1c-9853-4add-86ed-c05f0b696ce0_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1ff2cf1c-9853-4add-86ed-c05f0b696ce0_ext_7.jpg saved to cache
2025-12-04 10:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 836f12a0-cbbe-5a79-8594-40f844ef76d6
2025-12-04 10:07:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef50717b-454c-50b2-91b2-7aef0397fc2f with identifier: 3692062
2025-12-04 10:07:05 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item ef50717b-454c-50b2-91b2-7aef0397fc2f
2025-12-04 10:07:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc59c310>
2025-12-04 10:07:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:07:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_836f12a0-cbbe-5a79-8594-40f844ef76d6/836f12a0-cbbe-5a79-8594-40f844ef76d6_image_2.jpg HTTP/1.1" 201 0
2025-12-04 10:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1ff2cf1c-9853-4add-86ed-c05f0b696ce0_ext_6.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1ff2cf1c-9853-4add-86ed-c05f0b696ce0_ext_6.jpg saved to cache
2025-12-04 10:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 836f12a0-cbbe-5a79-8594-40f844ef76d6
2025-12-04 10:07:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1ff2cf1c-9853-4add-86ed-c05f0b696ce0_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003719784-01988521-002.pdf)
2025-12-04 10:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1ff2cf1c-9853-4add-86ed-c05f0b696ce0_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1ff2cf1c-9853-4add-86ed-c05f0b696ce0_ext_3.jpg not downloaded yet
2025-12-04 10:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1ff2cf1c-9853-4add-86ed-c05f0b696ce0_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1ff2cf1c-9853-4add-86ed-c05f0b696ce0_ext_4.jpg not downloaded yet
2025-12-04 10:07:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1ff2cf1c-9853-4add-86ed-c05f0b696ce0_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003719784-01988521-002.pdf)
2025-12-04 10:07:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/79d3f9d2-f35f-4d29-ae30-54140900dd77_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001966868-01991002-001.pdf)
2025-12-04 10:07:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc54c590>
2025-12-04 10:07:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:07:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f085d439-0f07-522a-b6ab-a69d48fc5f61/f085d439-0f07-522a-b6ab-a69d48fc5f61_expert_report_file_e6a4eb03-cc64-4e19-b4f7-a6390415fb9a.pdf HTTP/1.1" 201 0
2025-12-04 10:07:06 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item f085d439-0f07-522a-b6ab-a69d48fc5f61
2025-12-04 10:07:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f085d439-0f07-522a-b6ab-a69d48fc5f61, skipping ID generation
2025-12-04 10:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item f085d439-0f07-522a-b6ab-a69d48fc5f61
2025-12-04 10:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1f0cc2dc-21d7-4ced-9aa4-0964ac28cb45_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1f0cc2dc-21d7-4ced-9aa4-0964ac28cb45_ext_7.jpg already downloaded
2025-12-04 10:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1f0cc2dc-21d7-4ced-9aa4-0964ac28cb45_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1f0cc2dc-21d7-4ced-9aa4-0964ac28cb45_ext_7.jpg already downloaded
2025-12-04 10:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1f0cc2dc-21d7-4ced-9aa4-0964ac28cb45_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1f0cc2dc-21d7-4ced-9aa4-0964ac28cb45_ext_6.jpg already downloaded
2025-12-04 10:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1f0cc2dc-21d7-4ced-9aa4-0964ac28cb45_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1f0cc2dc-21d7-4ced-9aa4-0964ac28cb45_ext_1.jpg already downloaded
2025-12-04 10:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1f0cc2dc-21d7-4ced-9aa4-0964ac28cb45_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1f0cc2dc-21d7-4ced-9aa4-0964ac28cb45_5.jpg already downloaded
2025-12-04 10:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1f0cc2dc-21d7-4ced-9aa4-0964ac28cb45_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1f0cc2dc-21d7-4ced-9aa4-0964ac28cb45_4.jpg already downloaded
2025-12-04 10:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1f0cc2dc-21d7-4ced-9aa4-0964ac28cb45_11.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1f0cc2dc-21d7-4ced-9aa4-0964ac28cb45_11.jpg already downloaded
2025-12-04 10:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1f0cc2dc-21d7-4ced-9aa4-0964ac28cb45_10.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1f0cc2dc-21d7-4ced-9aa4-0964ac28cb45_10.jpg already downloaded
2025-12-04 10:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1f0cc2dc-21d7-4ced-9aa4-0964ac28cb45_9.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1f0cc2dc-21d7-4ced-9aa4-0964ac28cb45_9.jpg already downloaded
2025-12-04 10:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1f0cc2dc-21d7-4ced-9aa4-0964ac28cb45_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1f0cc2dc-21d7-4ced-9aa4-0964ac28cb45_ext_2.jpg already downloaded
2025-12-04 10:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1f0cc2dc-21d7-4ced-9aa4-0964ac28cb45_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1f0cc2dc-21d7-4ced-9aa4-0964ac28cb45_ext_5.jpg already downloaded
2025-12-04 10:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1f0cc2dc-21d7-4ced-9aa4-0964ac28cb45_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1f0cc2dc-21d7-4ced-9aa4-0964ac28cb45_ext_3.jpg already downloaded
2025-12-04 10:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1f0cc2dc-21d7-4ced-9aa4-0964ac28cb45_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1f0cc2dc-21d7-4ced-9aa4-0964ac28cb45_ext_4.jpg already downloaded
2025-12-04 10:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3696287-4003538-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3696287-4003538-13.jpg not downloaded yet
2025-12-04 10:07:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6f12d0>
2025-12-04 10:07:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:07:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_836f12a0-cbbe-5a79-8594-40f844ef76d6/836f12a0-cbbe-5a79-8594-40f844ef76d6_image_4.jpg HTTP/1.1" 201 0
2025-12-04 10:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1ff2cf1c-9853-4add-86ed-c05f0b696ce0_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1ff2cf1c-9853-4add-86ed-c05f0b696ce0_5.jpg saved to cache
2025-12-04 10:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 836f12a0-cbbe-5a79-8594-40f844ef76d6
2025-12-04 10:07:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cccd2cd0>
2025-12-04 10:07:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:07:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_836f12a0-cbbe-5a79-8594-40f844ef76d6/836f12a0-cbbe-5a79-8594-40f844ef76d6_image_3.jpg HTTP/1.1" 201 0
2025-12-04 10:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1ff2cf1c-9853-4add-86ed-c05f0b696ce0_ext_1.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1ff2cf1c-9853-4add-86ed-c05f0b696ce0_ext_1.jpg saved to cache
2025-12-04 10:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 836f12a0-cbbe-5a79-8594-40f844ef76d6
2025-12-04 10:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3719784-4003217-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3719784-4003217-13.jpg not downloaded yet
2025-12-04 10:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3696287-4003538-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3696287-4003538-1000.jpg not downloaded yet
2025-12-04 10:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3719784-4003217-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3719784-4003217-1000.jpg not downloaded yet
2025-12-04 10:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/KIA/RIO?id=3691518&returnUrl=%2Fsearch%3FPage%3D4%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233691518&indx=341> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 10:07:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd1e310>
2025-12-04 10:07:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:07:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_836f12a0-cbbe-5a79-8594-40f844ef76d6/836f12a0-cbbe-5a79-8594-40f844ef76d6_image_5.jpg HTTP/1.1" 201 0
2025-12-04 10:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1ff2cf1c-9853-4add-86ed-c05f0b696ce0_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1ff2cf1c-9853-4add-86ed-c05f0b696ce0_4.jpg saved to cache
2025-12-04 10:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 836f12a0-cbbe-5a79-8594-40f844ef76d6
2025-12-04 10:07:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd0dbb10>
2025-12-04 10:07:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:07:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_836f12a0-cbbe-5a79-8594-40f844ef76d6/836f12a0-cbbe-5a79-8594-40f844ef76d6_image_6.jpg HTTP/1.1" 201 0
2025-12-04 10:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1ff2cf1c-9853-4add-86ed-c05f0b696ce0_11.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1ff2cf1c-9853-4add-86ed-c05f0b696ce0_11.jpg saved to cache
2025-12-04 10:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 836f12a0-cbbe-5a79-8594-40f844ef76d6
2025-12-04 10:07:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf9ecd0>
2025-12-04 10:07:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:07:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_941069ff-ef30-5bba-82bd-388d3cb54f16/941069ff-ef30-5bba-82bd-388d3cb54f16_image_6.jpg HTTP/1.1" 201 0
2025-12-04 10:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F79d3f9d2-f35f-4d29-ae30-54140900dd77_11.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/79d3f9d2-f35f-4d29-ae30-54140900dd77_11.jpg saved to cache
2025-12-04 10:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 941069ff-ef30-5bba-82bd-388d3cb54f16
2025-12-04 10:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3696287-4003538-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3696287-4003538-1001.jpg not downloaded yet
2025-12-04 10:07:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 10:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3719784-4003217-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3719784-4003217-1001.jpg not downloaded yet
2025-12-04 10:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3696287-4003538-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3696287-4003538-1002.jpg not downloaded yet
2025-12-04 10:07:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e001225-d64f-5536-ba30-8054d03fb6bb with identifier: 3691518
2025-12-04 10:07:08 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 8e001225-d64f-5536-ba30-8054d03fb6bb
2025-12-04 10:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3719784-4003217-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3719784-4003217-1002.jpg not downloaded yet
2025-12-04 10:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3696287-4003538-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3696287-4003538-1003.jpg not downloaded yet
2025-12-04 10:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3719784-4003217-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3719784-4003217-1003.jpg not downloaded yet
2025-12-04 10:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3696287-4003538-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3696287-4003538-1004.jpg not downloaded yet
2025-12-04 10:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3719784-4003217-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3719784-4003217-1004.jpg not downloaded yet
2025-12-04 10:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3696287-4003538-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3696287-4003538-1005.jpg not downloaded yet
2025-12-04 10:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3719784-4003217-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3719784-4003217-1005.jpg not downloaded yet
2025-12-04 10:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3719784-4003217-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003719784-01988521-002.pdf)
2025-12-04 10:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3719784-4003217-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003719784-01988521-002.pdf)
2025-12-04 10:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3696287-4003538-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003696287-01975311-004.pdf)
2025-12-04 10:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3696287-4003538-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003696287-01975311-004.pdf)
2025-12-04 10:07:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5713d0>
2025-12-04 10:07:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:07:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_836f12a0-cbbe-5a79-8594-40f844ef76d6/836f12a0-cbbe-5a79-8594-40f844ef76d6_image_19.jpg HTTP/1.1" 201 0
2025-12-04 10:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3719784-4003217-1005.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3719784-4003217-1005.jpg saved to cache
2025-12-04 10:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 836f12a0-cbbe-5a79-8594-40f844ef76d6
2025-12-04 10:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3719784-4003217-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003719784-01988521-002.pdf)
2025-12-04 10:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3719784-4003217-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003719784-01988521-002.pdf)
2025-12-04 10:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3719784-4003217-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003719784-01988521-002.pdf)
2025-12-04 10:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3696287-4003538-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003696287-01975311-004.pdf)
2025-12-04 10:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3696287-4003538-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003696287-01975311-004.pdf)
2025-12-04 10:07:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf76a50>
2025-12-04 10:07:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 10:07:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_836f12a0-cbbe-5a79-8594-40f844ef76d6/836f12a0-cbbe-5a79-8594-40f844ef76d6_image_18.jpg HTTP/1.1" 201 0
2025-12-04 10:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3719784-4003217-1004.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3719784-4003217-1004.jpg saved to cache
2025-12-04 10:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 836f12a0-cbbe-5a79-8594-40f844ef76d6
2025-12-04 10:07:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf74890>
2025-12-04 10:07:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:07:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f085d439-0f07-522a-b6ab-a69d48fc5f61/f085d439-0f07-522a-b6ab-a69d48fc5f61_image_18.jpg HTTP/1.1" 201 0
2025-12-04 10:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3696287-4003538-1004.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3696287-4003538-1004.jpg saved to cache
2025-12-04 10:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item f085d439-0f07-522a-b6ab-a69d48fc5f61
2025-12-04 10:07:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce6ad90>
2025-12-04 10:07:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:07:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f085d439-0f07-522a-b6ab-a69d48fc5f61/f085d439-0f07-522a-b6ab-a69d48fc5f61_image_19.jpg HTTP/1.1" 201 0
2025-12-04 10:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3696287-4003538-1005.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3696287-4003538-1005.jpg saved to cache
2025-12-04 10:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item f085d439-0f07-522a-b6ab-a69d48fc5f61
2025-12-04 10:07:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3696287-4003538-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003696287-01975311-004.pdf)
2025-12-04 10:07:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3719784-4003217-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003719784-01988521-002.pdf)
2025-12-04 10:07:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc59f610>
2025-12-04 10:07:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:07:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_836f12a0-cbbe-5a79-8594-40f844ef76d6/836f12a0-cbbe-5a79-8594-40f844ef76d6_image_17.jpg HTTP/1.1" 201 0
2025-12-04 10:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3719784-4003217-1003.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3719784-4003217-1003.jpg saved to cache
2025-12-04 10:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 836f12a0-cbbe-5a79-8594-40f844ef76d6
2025-12-04 10:07:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccced390>
2025-12-04 10:07:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:07:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_836f12a0-cbbe-5a79-8594-40f844ef76d6/836f12a0-cbbe-5a79-8594-40f844ef76d6_image_16.jpg HTTP/1.1" 201 0
2025-12-04 10:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3719784-4003217-1002.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3719784-4003217-1002.jpg saved to cache
2025-12-04 10:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 836f12a0-cbbe-5a79-8594-40f844ef76d6
2025-12-04 10:07:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cccc4ad0>
2025-12-04 10:07:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:07:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_836f12a0-cbbe-5a79-8594-40f844ef76d6/836f12a0-cbbe-5a79-8594-40f844ef76d6_image_15.jpg HTTP/1.1" 201 0
2025-12-04 10:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3719784-4003217-1001.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3719784-4003217-1001.jpg saved to cache
2025-12-04 10:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 836f12a0-cbbe-5a79-8594-40f844ef76d6
2025-12-04 10:07:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cccee8d0>
2025-12-04 10:07:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:07:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f085d439-0f07-522a-b6ab-a69d48fc5f61/f085d439-0f07-522a-b6ab-a69d48fc5f61_image_16.jpg HTTP/1.1" 201 0
2025-12-04 10:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3696287-4003538-1002.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3696287-4003538-1002.jpg saved to cache
2025-12-04 10:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item f085d439-0f07-522a-b6ab-a69d48fc5f61
2025-12-04 10:07:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd107790>
2025-12-04 10:07:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:07:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f085d439-0f07-522a-b6ab-a69d48fc5f61/f085d439-0f07-522a-b6ab-a69d48fc5f61_image_15.jpg HTTP/1.1" 201 0
2025-12-04 10:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3696287-4003538-1001.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3696287-4003538-1001.jpg saved to cache
2025-12-04 10:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item f085d439-0f07-522a-b6ab-a69d48fc5f61
2025-12-04 10:07:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3719784-4003217-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003719784-01988521-002.pdf)
2025-12-04 10:07:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1ff2cf1c-9853-4add-86ed-c05f0b696ce0_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003719784-01988521-002.pdf)
2025-12-04 10:07:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1ff2cf1c-9853-4add-86ed-c05f0b696ce0_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003719784-01988521-002.pdf)
2025-12-04 10:07:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc573490>
2025-12-04 10:07:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:07:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f085d439-0f07-522a-b6ab-a69d48fc5f61/f085d439-0f07-522a-b6ab-a69d48fc5f61_image_17.jpg HTTP/1.1" 201 0
2025-12-04 10:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3696287-4003538-1003.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3696287-4003538-1003.jpg saved to cache
2025-12-04 10:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item f085d439-0f07-522a-b6ab-a69d48fc5f61
2025-12-04 10:07:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccc83a90>
2025-12-04 10:07:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:07:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_836f12a0-cbbe-5a79-8594-40f844ef76d6/836f12a0-cbbe-5a79-8594-40f844ef76d6_image_14.jpg HTTP/1.1" 201 0
2025-12-04 10:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3719784-4003217-1000.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3719784-4003217-1000.jpg saved to cache
2025-12-04 10:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 836f12a0-cbbe-5a79-8594-40f844ef76d6
2025-12-04 10:07:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3696287-4003538-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003696287-01975311-004.pdf)
2025-12-04 10:07:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3696287-4003538-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003696287-01975311-004.pdf)
2025-12-04 10:07:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc60acd0>
2025-12-04 10:07:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:07:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_836f12a0-cbbe-5a79-8594-40f844ef76d6/836f12a0-cbbe-5a79-8594-40f844ef76d6_image_13.jpg HTTP/1.1" 201 0
2025-12-04 10:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3719784-4003217-13.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3719784-4003217-13.jpg saved to cache
2025-12-04 10:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 836f12a0-cbbe-5a79-8594-40f844ef76d6
2025-12-04 10:07:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccc9d190>
2025-12-04 10:07:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:07:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_836f12a0-cbbe-5a79-8594-40f844ef76d6/836f12a0-cbbe-5a79-8594-40f844ef76d6_image_12.jpg HTTP/1.1" 201 0
2025-12-04 10:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1ff2cf1c-9853-4add-86ed-c05f0b696ce0_ext_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1ff2cf1c-9853-4add-86ed-c05f0b696ce0_ext_4.jpg saved to cache
2025-12-04 10:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 836f12a0-cbbe-5a79-8594-40f844ef76d6
2025-12-04 10:07:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc671c90>
2025-12-04 10:07:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:07:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_836f12a0-cbbe-5a79-8594-40f844ef76d6/836f12a0-cbbe-5a79-8594-40f844ef76d6_image_11.jpg HTTP/1.1" 201 0
2025-12-04 10:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1ff2cf1c-9853-4add-86ed-c05f0b696ce0_ext_3.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1ff2cf1c-9853-4add-86ed-c05f0b696ce0_ext_3.jpg saved to cache
2025-12-04 10:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 836f12a0-cbbe-5a79-8594-40f844ef76d6
2025-12-04 10:07:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1ff2cf1c-9853-4add-86ed-c05f0b696ce0_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003719784-01988521-002.pdf)
2025-12-04 10:07:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1ff2cf1c-9853-4add-86ed-c05f0b696ce0_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003719784-01988521-002.pdf)
2025-12-04 10:07:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1ff2cf1c-9853-4add-86ed-c05f0b696ce0_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003719784-01988521-002.pdf)
2025-12-04 10:07:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6d2d10>
2025-12-04 10:07:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:07:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f085d439-0f07-522a-b6ab-a69d48fc5f61/f085d439-0f07-522a-b6ab-a69d48fc5f61_image_14.jpg HTTP/1.1" 201 0
2025-12-04 10:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3696287-4003538-1000.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3696287-4003538-1000.jpg saved to cache
2025-12-04 10:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item f085d439-0f07-522a-b6ab-a69d48fc5f61
2025-12-04 10:07:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccdf4250>
2025-12-04 10:07:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:07:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f085d439-0f07-522a-b6ab-a69d48fc5f61/f085d439-0f07-522a-b6ab-a69d48fc5f61_image_13.jpg HTTP/1.1" 201 0
2025-12-04 10:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3696287-4003538-13.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3696287-4003538-13.jpg saved to cache
2025-12-04 10:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item f085d439-0f07-522a-b6ab-a69d48fc5f61
2025-12-04 10:07:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f085d439-0f07-522a-b6ab-a69d48fc5f61, skipping ID generation
2025-12-04 10:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Removing item f085d439-0f07-522a-b6ab-a69d48fc5f61 from tracking dictionaries
2025-12-04 10:07:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f085d439-0f07-522a-b6ab-a69d48fc5f61 sending to next pipeline
2025-12-04 10:07:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: f085d439-0f07-522a-b6ab-a69d48fc5f61, identifier: 3696287
2025-12-04 10:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003693298-1001400926-002.pdf> (referer: None)
2025-12-04 10:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1ff2cf1c-9853-4add-86ed-c05f0b696ce0_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003719784-01988521-002.pdf)
2025-12-04 10:07:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: f085d439-0f07-522a-b6ab-a69d48fc5f61 with identifier: 3696287
2025-12-04 10:07:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: f085d439-0f07-522a-b6ab-a69d48fc5f61 with identifier: 3696287
2025-12-04 10:07:13 [scrapy.core.scraper] INFO: Dropped: Dropping expired listing: f085d439-0f07-522a-b6ab-a69d48fc5f61 with expiration date: 2025-12-04T09:00:00Z
{'auction_title': '',
 'c_o_2_emission_value': 177,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f085d439-0f07-522a-b6ab-a69d48fc5f61/f085d439-0f07-522a-b6ab-a69d48fc5f61_expert_report_file_e6a4eb03-cc64-4e19-b4f7-a6390415fb9a.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003696287-01975311-004.pdf',
 'color': 'SILVER',
 'currency': 'GBP',
 'engine': '2.2L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'f085d439-0f07-522a-b6ab-a69d48fc5f61',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'HV15KAE',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/KIA/SORENTO?id=3696287',
 'listing': 'auction',
 'location': 'Leeds',
 'make': 'KIA',
 'model': 'SORENTO',
 'odometer': 146687,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 52,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f085d439-0f07-522a-b6ab-a69d48fc5f61/f085d439-0f07-522a-b6ab-a69d48fc5f61_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 227037,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1f0cc2dc-21d7-4ced-9aa4-0964ac28cb45_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f085d439-0f07-522a-b6ab-a69d48fc5f61/f085d439-0f07-522a-b6ab-a69d48fc5f61_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 227037,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1f0cc2dc-21d7-4ced-9aa4-0964ac28cb45_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f085d439-0f07-522a-b6ab-a69d48fc5f61/f085d439-0f07-522a-b6ab-a69d48fc5f61_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 249705,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1f0cc2dc-21d7-4ced-9aa4-0964ac28cb45_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f085d439-0f07-522a-b6ab-a69d48fc5f61/f085d439-0f07-522a-b6ab-a69d48fc5f61_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 184441,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1f0cc2dc-21d7-4ced-9aa4-0964ac28cb45_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f085d439-0f07-522a-b6ab-a69d48fc5f61/f085d439-0f07-522a-b6ab-a69d48fc5f61_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 219522,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1f0cc2dc-21d7-4ced-9aa4-0964ac28cb45_5.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f085d439-0f07-522a-b6ab-a69d48fc5f61/f085d439-0f07-522a-b6ab-a69d48fc5f61_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 226730,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1f0cc2dc-21d7-4ced-9aa4-0964ac28cb45_4.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f085d439-0f07-522a-b6ab-a69d48fc5f61/f085d439-0f07-522a-b6ab-a69d48fc5f61_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 213558,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1f0cc2dc-21d7-4ced-9aa4-0964ac28cb45_11.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f085d439-0f07-522a-b6ab-a69d48fc5f61/f085d439-0f07-522a-b6ab-a69d48fc5f61_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 201732,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1f0cc2dc-21d7-4ced-9aa4-0964ac28cb45_10.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f085d439-0f07-522a-b6ab-a69d48fc5f61/f085d439-0f07-522a-b6ab-a69d48fc5f61_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 213797,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1f0cc2dc-21d7-4ced-9aa4-0964ac28cb45_9.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f085d439-0f07-522a-b6ab-a69d48fc5f61/f085d439-0f07-522a-b6ab-a69d48fc5f61_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 267022,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1f0cc2dc-21d7-4ced-9aa4-0964ac28cb45_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f085d439-0f07-522a-b6ab-a69d48fc5f61/f085d439-0f07-522a-b6ab-a69d48fc5f61_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 262363,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1f0cc2dc-21d7-4ced-9aa4-0964ac28cb45_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f085d439-0f07-522a-b6ab-a69d48fc5f61/f085d439-0f07-522a-b6ab-a69d48fc5f61_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 252108,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1f0cc2dc-21d7-4ced-9aa4-0964ac28cb45_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f085d439-0f07-522a-b6ab-a69d48fc5f61/f085d439-0f07-522a-b6ab-a69d48fc5f61_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 240444,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1f0cc2dc-21d7-4ced-9aa4-0964ac28cb45_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f085d439-0f07-522a-b6ab-a69d48fc5f61/f085d439-0f07-522a-b6ab-a69d48fc5f61_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 346969,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3696287-4003538-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f085d439-0f07-522a-b6ab-a69d48fc5f61/f085d439-0f07-522a-b6ab-a69d48fc5f61_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 281910,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3696287-4003538-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f085d439-0f07-522a-b6ab-a69d48fc5f61/f085d439-0f07-522a-b6ab-a69d48fc5f61_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 246177,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3696287-4003538-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f085d439-0f07-522a-b6ab-a69d48fc5f61/f085d439-0f07-522a-b6ab-a69d48fc5f61_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 153633,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3696287-4003538-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f085d439-0f07-522a-b6ab-a69d48fc5f61/f085d439-0f07-522a-b6ab-a69d48fc5f61_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 336132,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3696287-4003538-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f085d439-0f07-522a-b6ab-a69d48fc5f61/f085d439-0f07-522a-b6ab-a69d48fc5f61_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 180445,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3696287-4003538-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f085d439-0f07-522a-b6ab-a69d48fc5f61/f085d439-0f07-522a-b6ab-a69d48fc5f61_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 212079,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3696287-4003538-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-29',
 'seller_name': 'Motor Dough',
 'title': 'KIA SORENTO 2.2 CRDi KX-4 5dr Auto',
 'transmission': 'automatic',
 'trim': '2.2 CRDi KX-4 5dr Auto',
 'year': 2015}
2025-12-04 10:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273696287%27 HTTP/1.1" 200 None
2025-12-04 10:07:13 [manheim.gb] INFO: Saving data for 3696287: {'created_time': 1764842833.062871, 'last_price_update_time': 1764842833.062879, 'auction_closing_time': 1764838800.0}
2025-12-04 10:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3696287') HTTP/1.1" 204 0
2025-12-04 10:07:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6f3410>
2025-12-04 10:07:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:07:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_836f12a0-cbbe-5a79-8594-40f844ef76d6/836f12a0-cbbe-5a79-8594-40f844ef76d6_image_8.jpg HTTP/1.1" 201 0
2025-12-04 10:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1ff2cf1c-9853-4add-86ed-c05f0b696ce0_9.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1ff2cf1c-9853-4add-86ed-c05f0b696ce0_9.jpg saved to cache
2025-12-04 10:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 836f12a0-cbbe-5a79-8594-40f844ef76d6
2025-12-04 10:07:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6daa90>
2025-12-04 10:07:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:07:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_836f12a0-cbbe-5a79-8594-40f844ef76d6/836f12a0-cbbe-5a79-8594-40f844ef76d6_image_10.jpg HTTP/1.1" 201 0
2025-12-04 10:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1ff2cf1c-9853-4add-86ed-c05f0b696ce0_ext_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1ff2cf1c-9853-4add-86ed-c05f0b696ce0_ext_5.jpg saved to cache
2025-12-04 10:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 836f12a0-cbbe-5a79-8594-40f844ef76d6
2025-12-04 10:07:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf086d0>
2025-12-04 10:07:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:07:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_836f12a0-cbbe-5a79-8594-40f844ef76d6/836f12a0-cbbe-5a79-8594-40f844ef76d6_image_7.jpg HTTP/1.1" 201 0
2025-12-04 10:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1ff2cf1c-9853-4add-86ed-c05f0b696ce0_10.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1ff2cf1c-9853-4add-86ed-c05f0b696ce0_10.jpg saved to cache
2025-12-04 10:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 836f12a0-cbbe-5a79-8594-40f844ef76d6
2025-12-04 10:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1564179-4007572-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001564179-01991001-001.pdf)
2025-12-04 10:07:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccedb410>
2025-12-04 10:07:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:07:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df58e7f8-61e7-56dd-9423-3b35c4acd52f/df58e7f8-61e7-56dd-9423-3b35c4acd52f_expert_report_file_3d0c97c7-3d47-43a2-84c1-f831f08b738c.pdf HTTP/1.1" 201 0
2025-12-04 10:07:14 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item df58e7f8-61e7-56dd-9423-3b35c4acd52f
2025-12-04 10:07:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: df58e7f8-61e7-56dd-9423-3b35c4acd52f, skipping ID generation
2025-12-04 10:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item df58e7f8-61e7-56dd-9423-3b35c4acd52f
2025-12-04 10:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F03ec0254-4d90-4b3a-bada-4e8408ad022f_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/03ec0254-4d90-4b3a-bada-4e8408ad022f_ext_7.jpg not downloaded yet
2025-12-04 10:07:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce6bb90>
2025-12-04 10:07:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:07:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_836f12a0-cbbe-5a79-8594-40f844ef76d6/836f12a0-cbbe-5a79-8594-40f844ef76d6_image_9.jpg HTTP/1.1" 201 0
2025-12-04 10:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1ff2cf1c-9853-4add-86ed-c05f0b696ce0_ext_2.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1ff2cf1c-9853-4add-86ed-c05f0b696ce0_ext_2.jpg saved to cache
2025-12-04 10:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 836f12a0-cbbe-5a79-8594-40f844ef76d6
2025-12-04 10:07:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 836f12a0-cbbe-5a79-8594-40f844ef76d6, skipping ID generation
2025-12-04 10:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 836f12a0-cbbe-5a79-8594-40f844ef76d6 from tracking dictionaries
2025-12-04 10:07:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 836f12a0-cbbe-5a79-8594-40f844ef76d6 sending to next pipeline
2025-12-04 10:07:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 836f12a0-cbbe-5a79-8594-40f844ef76d6, identifier: 3719784
2025-12-04 10:07:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 836f12a0-cbbe-5a79-8594-40f844ef76d6 with identifier: 3719784
2025-12-04 10:07:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 836f12a0-cbbe-5a79-8594-40f844ef76d6 with identifier: 3719784
2025-12-04 10:07:14 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 836f12a0-cbbe-5a79-8594-40f844ef76d6 with identifier: 3719784 to the API
2025-12-04 10:07:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 10:07:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 10:07:15 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/1ff2cf1c-9853-4add-86ed-c05f0b696ce0_ext_2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_836f12a0-cbbe-5a79-8594-40f844ef76d6/836f12a0-cbbe-5a79-8594-40f844ef76d6_expert_report_file_f5cf00f7-cd85-4825-bb70-3d32a54e8bee.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003719784-01988521-002.pdf',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '836f12a0-cbbe-5a79-8594-40f844ef76d6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'BW66HPP',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/CITROEN/C3%20PICASSO?id=3719784',
 'listing': 'auction',
 'location': 'Northampton',
 'make': 'CITROEN',
 'model': 'C3 PICASSO',
 'odometer': 72186,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 27,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_836f12a0-cbbe-5a79-8594-40f844ef76d6/836f12a0-cbbe-5a79-8594-40f844ef76d6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 223499,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1ff2cf1c-9853-4add-86ed-c05f0b696ce0_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_836f12a0-cbbe-5a79-8594-40f844ef76d6/836f12a0-cbbe-5a79-8594-40f844ef76d6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 223499,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1ff2cf1c-9853-4add-86ed-c05f0b696ce0_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_836f12a0-cbbe-5a79-8594-40f844ef76d6/836f12a0-cbbe-5a79-8594-40f844ef76d6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 244384,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1ff2cf1c-9853-4add-86ed-c05f0b696ce0_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_836f12a0-cbbe-5a79-8594-40f844ef76d6/836f12a0-cbbe-5a79-8594-40f844ef76d6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 170073,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1ff2cf1c-9853-4add-86ed-c05f0b696ce0_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_836f12a0-cbbe-5a79-8594-40f844ef76d6/836f12a0-cbbe-5a79-8594-40f844ef76d6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 219584,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1ff2cf1c-9853-4add-86ed-c05f0b696ce0_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_836f12a0-cbbe-5a79-8594-40f844ef76d6/836f12a0-cbbe-5a79-8594-40f844ef76d6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 198694,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1ff2cf1c-9853-4add-86ed-c05f0b696ce0_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_836f12a0-cbbe-5a79-8594-40f844ef76d6/836f12a0-cbbe-5a79-8594-40f844ef76d6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 220887,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1ff2cf1c-9853-4add-86ed-c05f0b696ce0_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_836f12a0-cbbe-5a79-8594-40f844ef76d6/836f12a0-cbbe-5a79-8594-40f844ef76d6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 206448,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1ff2cf1c-9853-4add-86ed-c05f0b696ce0_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_836f12a0-cbbe-5a79-8594-40f844ef76d6/836f12a0-cbbe-5a79-8594-40f844ef76d6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 230817,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1ff2cf1c-9853-4add-86ed-c05f0b696ce0_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_836f12a0-cbbe-5a79-8594-40f844ef76d6/836f12a0-cbbe-5a79-8594-40f844ef76d6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 272099,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1ff2cf1c-9853-4add-86ed-c05f0b696ce0_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_836f12a0-cbbe-5a79-8594-40f844ef76d6/836f12a0-cbbe-5a79-8594-40f844ef76d6_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 221571,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1ff2cf1c-9853-4add-86ed-c05f0b696ce0_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_836f12a0-cbbe-5a79-8594-40f844ef76d6/836f12a0-cbbe-5a79-8594-40f844ef76d6_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 242613,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1ff2cf1c-9853-4add-86ed-c05f0b696ce0_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_836f12a0-cbbe-5a79-8594-40f844ef76d6/836f12a0-cbbe-5a79-8594-40f844ef76d6_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 217356,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1ff2cf1c-9853-4add-86ed-c05f0b696ce0_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_836f12a0-cbbe-5a79-8594-40f844ef76d6/836f12a0-cbbe-5a79-8594-40f844ef76d6_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 186706,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3719784-4003217-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_836f12a0-cbbe-5a79-8594-40f844ef76d6/836f12a0-cbbe-5a79-8594-40f844ef76d6_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82259,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3719784-4003217-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_836f12a0-cbbe-5a79-8594-40f844ef76d6/836f12a0-cbbe-5a79-8594-40f844ef76d6_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 190957,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3719784-4003217-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_836f12a0-cbbe-5a79-8594-40f844ef76d6/836f12a0-cbbe-5a79-8594-40f844ef76d6_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 194200,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3719784-4003217-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_836f12a0-cbbe-5a79-8594-40f844ef76d6/836f12a0-cbbe-5a79-8594-40f844ef76d6_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 195995,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3719784-4003217-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_836f12a0-cbbe-5a79-8594-40f844ef76d6/836f12a0-cbbe-5a79-8594-40f844ef76d6_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 195020,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3719784-4003217-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_836f12a0-cbbe-5a79-8594-40f844ef76d6/836f12a0-cbbe-5a79-8594-40f844ef76d6_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 211992,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3719784-4003217-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-22',
 'seller_name': 'Croyland Car Megastore',
 'title': 'CITROEN C3 PICASSO 1.2 PureTech Edition 5dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech Edition 5dr',
 'year': 2016}
2025-12-04 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273719784%27 HTTP/1.1" 200 None
2025-12-04 10:07:15 [manheim.gb] INFO: Saving data for 3719784: {'created_time': 1764842835.245866, 'last_price_update_time': 1764842835.245876, 'auction_closing_time': 1765270800.0}
2025-12-04 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3719784') HTTP/1.1" 204 0
2025-12-04 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F03ec0254-4d90-4b3a-bada-4e8408ad022f_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/03ec0254-4d90-4b3a-bada-4e8408ad022f_ext_7.jpg not downloaded yet
2025-12-04 10:07:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/79d3f9d2-f35f-4d29-ae30-54140900dd77_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001966868-01991002-001.pdf)
2025-12-04 10:07:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1761741-4007528-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001761741-01991419-003.pdf)
2025-12-04 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F03ec0254-4d90-4b3a-bada-4e8408ad022f_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/03ec0254-4d90-4b3a-bada-4e8408ad022f_ext_6.jpg not downloaded yet
2025-12-04 10:07:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc53ef10>
2025-12-04 10:07:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:07:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9200c31a-aec5-5dca-8036-0876fcfb70f2/9200c31a-aec5-5dca-8036-0876fcfb70f2_image_17.jpg HTTP/1.1" 201 0
2025-12-04 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1564179-4007572-1003.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1564179-4007572-1003.jpg saved to cache
2025-12-04 10:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 9200c31a-aec5-5dca-8036-0876fcfb70f2
2025-12-04 10:07:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/79d3f9d2-f35f-4d29-ae30-54140900dd77_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001966868-01991002-001.pdf)
2025-12-04 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F03ec0254-4d90-4b3a-bada-4e8408ad022f_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/03ec0254-4d90-4b3a-bada-4e8408ad022f_ext_1.jpg not downloaded yet
2025-12-04 10:07:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6d2810>
2025-12-04 10:07:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:07:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_941069ff-ef30-5bba-82bd-388d3cb54f16/941069ff-ef30-5bba-82bd-388d3cb54f16_image_2.jpg HTTP/1.1" 201 0
2025-12-04 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F79d3f9d2-f35f-4d29-ae30-54140900dd77_ext_6.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/79d3f9d2-f35f-4d29-ae30-54140900dd77_ext_6.jpg saved to cache
2025-12-04 10:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 941069ff-ef30-5bba-82bd-388d3cb54f16
2025-12-04 10:07:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccca4c90>
2025-12-04 10:07:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:07:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08d45d44-06c8-5777-ab82-d212449d4408/08d45d44-06c8-5777-ab82-d212449d4408_image_17.jpg HTTP/1.1" 201 0
2025-12-04 10:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1761741-4007528-1003.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1761741-4007528-1003.jpg saved to cache
2025-12-04 10:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 08d45d44-06c8-5777-ab82-d212449d4408
2025-12-04 10:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F03ec0254-4d90-4b3a-bada-4e8408ad022f_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/03ec0254-4d90-4b3a-bada-4e8408ad022f_5.jpg not downloaded yet
2025-12-04 10:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F03ec0254-4d90-4b3a-bada-4e8408ad022f_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/03ec0254-4d90-4b3a-bada-4e8408ad022f_4.jpg not downloaded yet
2025-12-04 10:07:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd2d210>
2025-12-04 10:07:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:07:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_941069ff-ef30-5bba-82bd-388d3cb54f16/941069ff-ef30-5bba-82bd-388d3cb54f16_image_1.jpg HTTP/1.1" 201 0
2025-12-04 10:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F79d3f9d2-f35f-4d29-ae30-54140900dd77_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/79d3f9d2-f35f-4d29-ae30-54140900dd77_ext_7.jpg saved to cache
2025-12-04 10:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 941069ff-ef30-5bba-82bd-388d3cb54f16
2025-12-04 10:07:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/03ec0254-4d90-4b3a-bada-4e8408ad022f_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003693298-1001400926-002.pdf)
2025-12-04 10:07:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/03ec0254-4d90-4b3a-bada-4e8408ad022f_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003693298-1001400926-002.pdf)
2025-12-04 10:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F03ec0254-4d90-4b3a-bada-4e8408ad022f_11.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/03ec0254-4d90-4b3a-bada-4e8408ad022f_11.jpg not downloaded yet
2025-12-04 10:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F03ec0254-4d90-4b3a-bada-4e8408ad022f_10.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/03ec0254-4d90-4b3a-bada-4e8408ad022f_10.jpg not downloaded yet
2025-12-04 10:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F03ec0254-4d90-4b3a-bada-4e8408ad022f_9.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/03ec0254-4d90-4b3a-bada-4e8408ad022f_9.jpg not downloaded yet
2025-12-04 10:07:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/03ec0254-4d90-4b3a-bada-4e8408ad022f_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003693298-1001400926-002.pdf)
2025-12-04 10:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F03ec0254-4d90-4b3a-bada-4e8408ad022f_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/03ec0254-4d90-4b3a-bada-4e8408ad022f_ext_2.jpg not downloaded yet
2025-12-04 10:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F03ec0254-4d90-4b3a-bada-4e8408ad022f_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/03ec0254-4d90-4b3a-bada-4e8408ad022f_ext_5.jpg not downloaded yet
2025-12-04 10:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F03ec0254-4d90-4b3a-bada-4e8408ad022f_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/03ec0254-4d90-4b3a-bada-4e8408ad022f_ext_3.jpg not downloaded yet
2025-12-04 10:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F03ec0254-4d90-4b3a-bada-4e8408ad022f_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/03ec0254-4d90-4b3a-bada-4e8408ad022f_ext_4.jpg not downloaded yet
2025-12-04 10:07:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cccd2550>
2025-12-04 10:07:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:07:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df58e7f8-61e7-56dd-9423-3b35c4acd52f/df58e7f8-61e7-56dd-9423-3b35c4acd52f_image_0.jpg HTTP/1.1" 201 0
2025-12-04 10:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F03ec0254-4d90-4b3a-bada-4e8408ad022f_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/03ec0254-4d90-4b3a-bada-4e8408ad022f_ext_7.jpg saved to cache
2025-12-04 10:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item df58e7f8-61e7-56dd-9423-3b35c4acd52f
2025-12-04 10:07:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cced8d10>
2025-12-04 10:07:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:07:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df58e7f8-61e7-56dd-9423-3b35c4acd52f/df58e7f8-61e7-56dd-9423-3b35c4acd52f_image_1.jpg HTTP/1.1" 201 0
2025-12-04 10:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F03ec0254-4d90-4b3a-bada-4e8408ad022f_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/03ec0254-4d90-4b3a-bada-4e8408ad022f_ext_7.jpg saved to cache
2025-12-04 10:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item df58e7f8-61e7-56dd-9423-3b35c4acd52f
2025-12-04 10:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3693298-3631035-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3693298-3631035-13.jpg not downloaded yet
2025-12-04 10:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3693298-3631035-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3693298-3631035-1000.jpg not downloaded yet
2025-12-04 10:07:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/03ec0254-4d90-4b3a-bada-4e8408ad022f_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003693298-1001400926-002.pdf)
2025-12-04 10:07:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/03ec0254-4d90-4b3a-bada-4e8408ad022f_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003693298-1001400926-002.pdf)
2025-12-04 10:07:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/03ec0254-4d90-4b3a-bada-4e8408ad022f_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003693298-1001400926-002.pdf)
2025-12-04 10:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3693298-3631035-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3693298-3631035-1001.jpg not downloaded yet
2025-12-04 10:07:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd00b8d0>
2025-12-04 10:07:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:07:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df58e7f8-61e7-56dd-9423-3b35c4acd52f/df58e7f8-61e7-56dd-9423-3b35c4acd52f_image_2.jpg HTTP/1.1" 201 0
2025-12-04 10:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F03ec0254-4d90-4b3a-bada-4e8408ad022f_ext_6.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/03ec0254-4d90-4b3a-bada-4e8408ad022f_ext_6.jpg saved to cache
2025-12-04 10:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item df58e7f8-61e7-56dd-9423-3b35c4acd52f
2025-12-04 10:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3693298-3631035-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3693298-3631035-1002.jpg not downloaded yet
2025-12-04 10:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3693298-3631035-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3693298-3631035-1003.jpg not downloaded yet
2025-12-04 10:07:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccc6a990>
2025-12-04 10:07:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:07:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df58e7f8-61e7-56dd-9423-3b35c4acd52f/df58e7f8-61e7-56dd-9423-3b35c4acd52f_image_5.jpg HTTP/1.1" 201 0
2025-12-04 10:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F03ec0254-4d90-4b3a-bada-4e8408ad022f_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/03ec0254-4d90-4b3a-bada-4e8408ad022f_4.jpg saved to cache
2025-12-04 10:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item df58e7f8-61e7-56dd-9423-3b35c4acd52f
2025-12-04 10:07:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ce3a1490>
2025-12-04 10:07:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:07:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df58e7f8-61e7-56dd-9423-3b35c4acd52f/df58e7f8-61e7-56dd-9423-3b35c4acd52f_image_4.jpg HTTP/1.1" 201 0
2025-12-04 10:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F03ec0254-4d90-4b3a-bada-4e8408ad022f_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/03ec0254-4d90-4b3a-bada-4e8408ad022f_5.jpg saved to cache
2025-12-04 10:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item df58e7f8-61e7-56dd-9423-3b35c4acd52f
2025-12-04 10:07:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc69cc50>
2025-12-04 10:07:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:07:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df58e7f8-61e7-56dd-9423-3b35c4acd52f/df58e7f8-61e7-56dd-9423-3b35c4acd52f_image_7.jpg HTTP/1.1" 201 0
2025-12-04 10:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F03ec0254-4d90-4b3a-bada-4e8408ad022f_10.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/03ec0254-4d90-4b3a-bada-4e8408ad022f_10.jpg saved to cache
2025-12-04 10:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item df58e7f8-61e7-56dd-9423-3b35c4acd52f
2025-12-04 10:07:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003692062-01991320-002.pdf> (referer: None)
2025-12-04 10:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3693298-3631035-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3693298-3631035-1004.jpg not downloaded yet
2025-12-04 10:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3693298-3631035-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3693298-3631035-1005.jpg not downloaded yet
2025-12-04 10:07:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3693298-3631035-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003693298-1001400926-002.pdf)
2025-12-04 10:07:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3693298-3631035-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003693298-1001400926-002.pdf)
2025-12-04 10:07:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003691518-01987696-002.pdf> (referer: None)
2025-12-04 10:07:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/03ec0254-4d90-4b3a-bada-4e8408ad022f_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003693298-1001400926-002.pdf)
2025-12-04 10:07:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5c8f10>
2025-12-04 10:07:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:07:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef50717b-454c-50b2-91b2-7aef0397fc2f/ef50717b-454c-50b2-91b2-7aef0397fc2f_expert_report_file_7cbeb372-c0a3-420b-8496-99169e264739.pdf HTTP/1.1" 201 0
2025-12-04 10:07:18 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item ef50717b-454c-50b2-91b2-7aef0397fc2f
2025-12-04 10:07:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ef50717b-454c-50b2-91b2-7aef0397fc2f, skipping ID generation
2025-12-04 10:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item ef50717b-454c-50b2-91b2-7aef0397fc2f
2025-12-04 10:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F699f11a1-f464-4c0f-8e30-c0e59677185f_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/699f11a1-f464-4c0f-8e30-c0e59677185f_ext_7.jpg not downloaded yet
2025-12-04 10:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F699f11a1-f464-4c0f-8e30-c0e59677185f_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/699f11a1-f464-4c0f-8e30-c0e59677185f_ext_7.jpg not downloaded yet
2025-12-04 10:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F699f11a1-f464-4c0f-8e30-c0e59677185f_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/699f11a1-f464-4c0f-8e30-c0e59677185f_ext_6.jpg not downloaded yet
2025-12-04 10:07:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3693298-3631035-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003693298-1001400926-002.pdf)
2025-12-04 10:07:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc63fe90>
2025-12-04 10:07:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:07:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df58e7f8-61e7-56dd-9423-3b35c4acd52f/df58e7f8-61e7-56dd-9423-3b35c4acd52f_image_13.jpg HTTP/1.1" 201 0
2025-12-04 10:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3693298-3631035-13.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3693298-3631035-13.jpg saved to cache
2025-12-04 10:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item df58e7f8-61e7-56dd-9423-3b35c4acd52f
2025-12-04 10:07:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc7dfd50>
2025-12-04 10:07:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:07:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df58e7f8-61e7-56dd-9423-3b35c4acd52f/df58e7f8-61e7-56dd-9423-3b35c4acd52f_image_14.jpg HTTP/1.1" 201 0
2025-12-04 10:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3693298-3631035-1000.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3693298-3631035-1000.jpg saved to cache
2025-12-04 10:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item df58e7f8-61e7-56dd-9423-3b35c4acd52f
2025-12-04 10:07:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce11050>
2025-12-04 10:07:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:07:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e001225-d64f-5536-ba30-8054d03fb6bb/8e001225-d64f-5536-ba30-8054d03fb6bb_expert_report_file_076dee40-596d-40ef-8192-c27d4300afd8.pdf HTTP/1.1" 201 0
2025-12-04 10:07:21 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 8e001225-d64f-5536-ba30-8054d03fb6bb
2025-12-04 10:07:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8e001225-d64f-5536-ba30-8054d03fb6bb, skipping ID generation
2025-12-04 10:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 8e001225-d64f-5536-ba30-8054d03fb6bb
2025-12-04 10:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7007a6df-0b80-4ee6-88c4-80087bd44eb6_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7007a6df-0b80-4ee6-88c4-80087bd44eb6_ext_7.jpg not downloaded yet
2025-12-04 10:07:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccc5e4d0>
2025-12-04 10:07:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:07:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df58e7f8-61e7-56dd-9423-3b35c4acd52f/df58e7f8-61e7-56dd-9423-3b35c4acd52f_image_12.jpg HTTP/1.1" 201 0
2025-12-04 10:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F03ec0254-4d90-4b3a-bada-4e8408ad022f_ext_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/03ec0254-4d90-4b3a-bada-4e8408ad022f_ext_4.jpg saved to cache
2025-12-04 10:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item df58e7f8-61e7-56dd-9423-3b35c4acd52f
2025-12-04 10:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F699f11a1-f464-4c0f-8e30-c0e59677185f_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/699f11a1-f464-4c0f-8e30-c0e59677185f_ext_1.jpg not downloaded yet
2025-12-04 10:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7007a6df-0b80-4ee6-88c4-80087bd44eb6_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7007a6df-0b80-4ee6-88c4-80087bd44eb6_ext_7.jpg not downloaded yet
2025-12-04 10:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F699f11a1-f464-4c0f-8e30-c0e59677185f_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/699f11a1-f464-4c0f-8e30-c0e59677185f_5.jpg not downloaded yet
2025-12-04 10:07:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VAUXHALL/CORSA?id=3677202&returnUrl=%2Fsearch%3FPage%3D4%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233677202&indx=333> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 10:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7007a6df-0b80-4ee6-88c4-80087bd44eb6_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7007a6df-0b80-4ee6-88c4-80087bd44eb6_ext_6.jpg not downloaded yet
2025-12-04 10:07:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 10:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F699f11a1-f464-4c0f-8e30-c0e59677185f_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/699f11a1-f464-4c0f-8e30-c0e59677185f_4.jpg not downloaded yet
2025-12-04 10:07:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc7cb7d0>
2025-12-04 10:07:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:07:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df58e7f8-61e7-56dd-9423-3b35c4acd52f/df58e7f8-61e7-56dd-9423-3b35c4acd52f_image_17.jpg HTTP/1.1" 201 0
2025-12-04 10:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3693298-3631035-1003.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3693298-3631035-1003.jpg saved to cache
2025-12-04 10:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item df58e7f8-61e7-56dd-9423-3b35c4acd52f
2025-12-04 10:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7007a6df-0b80-4ee6-88c4-80087bd44eb6_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7007a6df-0b80-4ee6-88c4-80087bd44eb6_ext_1.jpg not downloaded yet
2025-12-04 10:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F699f11a1-f464-4c0f-8e30-c0e59677185f_11.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/699f11a1-f464-4c0f-8e30-c0e59677185f_11.jpg not downloaded yet
2025-12-04 10:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7007a6df-0b80-4ee6-88c4-80087bd44eb6_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7007a6df-0b80-4ee6-88c4-80087bd44eb6_5.jpg not downloaded yet
2025-12-04 10:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F699f11a1-f464-4c0f-8e30-c0e59677185f_10.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/699f11a1-f464-4c0f-8e30-c0e59677185f_10.jpg not downloaded yet
2025-12-04 10:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7007a6df-0b80-4ee6-88c4-80087bd44eb6_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7007a6df-0b80-4ee6-88c4-80087bd44eb6_4.jpg not downloaded yet
2025-12-04 10:07:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2fbbc445-b915-58e2-ba7a-9c92dc3e12e7 with identifier: 3677202
2025-12-04 10:07:22 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 2fbbc445-b915-58e2-ba7a-9c92dc3e12e7
2025-12-04 10:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F699f11a1-f464-4c0f-8e30-c0e59677185f_9.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/699f11a1-f464-4c0f-8e30-c0e59677185f_9.jpg not downloaded yet
2025-12-04 10:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7007a6df-0b80-4ee6-88c4-80087bd44eb6_11.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7007a6df-0b80-4ee6-88c4-80087bd44eb6_11.jpg not downloaded yet
2025-12-04 10:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F699f11a1-f464-4c0f-8e30-c0e59677185f_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/699f11a1-f464-4c0f-8e30-c0e59677185f_ext_2.jpg not downloaded yet
2025-12-04 10:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7007a6df-0b80-4ee6-88c4-80087bd44eb6_10.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7007a6df-0b80-4ee6-88c4-80087bd44eb6_10.jpg not downloaded yet
2025-12-04 10:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F699f11a1-f464-4c0f-8e30-c0e59677185f_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/699f11a1-f464-4c0f-8e30-c0e59677185f_ext_5.jpg not downloaded yet
2025-12-04 10:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7007a6df-0b80-4ee6-88c4-80087bd44eb6_9.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7007a6df-0b80-4ee6-88c4-80087bd44eb6_9.jpg not downloaded yet
2025-12-04 10:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F699f11a1-f464-4c0f-8e30-c0e59677185f_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/699f11a1-f464-4c0f-8e30-c0e59677185f_ext_3.jpg not downloaded yet
2025-12-04 10:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7007a6df-0b80-4ee6-88c4-80087bd44eb6_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7007a6df-0b80-4ee6-88c4-80087bd44eb6_ext_2.jpg not downloaded yet
2025-12-04 10:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F699f11a1-f464-4c0f-8e30-c0e59677185f_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/699f11a1-f464-4c0f-8e30-c0e59677185f_ext_4.jpg not downloaded yet
2025-12-04 10:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7007a6df-0b80-4ee6-88c4-80087bd44eb6_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7007a6df-0b80-4ee6-88c4-80087bd44eb6_ext_5.jpg not downloaded yet
2025-12-04 10:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3692062-4007588-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3692062-4007588-13.jpg not downloaded yet
2025-12-04 10:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7007a6df-0b80-4ee6-88c4-80087bd44eb6_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7007a6df-0b80-4ee6-88c4-80087bd44eb6_ext_3.jpg not downloaded yet
2025-12-04 10:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3692062-4007588-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3692062-4007588-1000.jpg not downloaded yet
2025-12-04 10:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7007a6df-0b80-4ee6-88c4-80087bd44eb6_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7007a6df-0b80-4ee6-88c4-80087bd44eb6_ext_4.jpg not downloaded yet
2025-12-04 10:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3692062-4007588-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3692062-4007588-1001.jpg not downloaded yet
2025-12-04 10:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3691518-4006627-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3691518-4006627-13.jpg not downloaded yet
2025-12-04 10:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3692062-4007588-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3692062-4007588-1002.jpg not downloaded yet
2025-12-04 10:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3691518-4006627-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3691518-4006627-1000.jpg not downloaded yet
2025-12-04 10:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3692062-4007588-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3692062-4007588-1003.jpg not downloaded yet
2025-12-04 10:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3691518-4006627-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3691518-4006627-1001.jpg not downloaded yet
2025-12-04 10:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3692062-4007588-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3692062-4007588-1004.jpg not downloaded yet
2025-12-04 10:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3691518-4006627-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3691518-4006627-1002.jpg not downloaded yet
2025-12-04 10:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3692062-4007588-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3692062-4007588-1005.jpg not downloaded yet
2025-12-04 10:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3691518-4006627-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3691518-4006627-1003.jpg not downloaded yet
2025-12-04 10:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3691518-4006627-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3691518-4006627-1004.jpg not downloaded yet
2025-12-04 10:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3691518-4006627-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3691518-4006627-1005.jpg not downloaded yet
2025-12-04 10:07:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3692062-4007588-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003692062-01991320-002.pdf)
2025-12-04 10:07:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3691518-4006627-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003691518-01987696-002.pdf)
2025-12-04 10:07:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3691518-4006627-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003691518-01987696-002.pdf)
2025-12-04 10:07:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3692062-4007588-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003692062-01991320-002.pdf)
2025-12-04 10:07:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3691518-4006627-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003691518-01987696-002.pdf)
2025-12-04 10:07:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd88690>
2025-12-04 10:07:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:07:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef50717b-454c-50b2-91b2-7aef0397fc2f/ef50717b-454c-50b2-91b2-7aef0397fc2f_image_18.jpg HTTP/1.1" 201 0
2025-12-04 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3692062-4007588-1004.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3692062-4007588-1004.jpg saved to cache
2025-12-04 10:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item ef50717b-454c-50b2-91b2-7aef0397fc2f
2025-12-04 10:07:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3692062-4007588-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003692062-01991320-002.pdf)
2025-12-04 10:07:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3692062-4007588-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003692062-01991320-002.pdf)
2025-12-04 10:07:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccedab50>
2025-12-04 10:07:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:07:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e001225-d64f-5536-ba30-8054d03fb6bb/8e001225-d64f-5536-ba30-8054d03fb6bb_image_17.jpg HTTP/1.1" 201 0
2025-12-04 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3691518-4006627-1003.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3691518-4006627-1003.jpg saved to cache
2025-12-04 10:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 8e001225-d64f-5536-ba30-8054d03fb6bb
2025-12-04 10:07:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce09990>
2025-12-04 10:07:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:07:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e001225-d64f-5536-ba30-8054d03fb6bb/8e001225-d64f-5536-ba30-8054d03fb6bb_image_18.jpg HTTP/1.1" 201 0
2025-12-04 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3691518-4006627-1004.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3691518-4006627-1004.jpg saved to cache
2025-12-04 10:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 8e001225-d64f-5536-ba30-8054d03fb6bb
2025-12-04 10:07:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce6abd0>
2025-12-04 10:07:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:07:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef50717b-454c-50b2-91b2-7aef0397fc2f/ef50717b-454c-50b2-91b2-7aef0397fc2f_image_19.jpg HTTP/1.1" 201 0
2025-12-04 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3692062-4007588-1005.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3692062-4007588-1005.jpg saved to cache
2025-12-04 10:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item ef50717b-454c-50b2-91b2-7aef0397fc2f
2025-12-04 10:07:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc602d90>
2025-12-04 10:07:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:07:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e001225-d64f-5536-ba30-8054d03fb6bb/8e001225-d64f-5536-ba30-8054d03fb6bb_image_16.jpg HTTP/1.1" 201 0
2025-12-04 10:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3691518-4006627-1002.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3691518-4006627-1002.jpg saved to cache
2025-12-04 10:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 8e001225-d64f-5536-ba30-8054d03fb6bb
2025-12-04 10:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3691518-4006627-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003691518-01987696-002.pdf)
2025-12-04 10:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3691518-4006627-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003691518-01987696-002.pdf)
2025-12-04 10:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3691518-4006627-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003691518-01987696-002.pdf)
2025-12-04 10:07:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce77890>
2025-12-04 10:07:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:07:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef50717b-454c-50b2-91b2-7aef0397fc2f/ef50717b-454c-50b2-91b2-7aef0397fc2f_image_17.jpg HTTP/1.1" 201 0
2025-12-04 10:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3692062-4007588-1003.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3692062-4007588-1003.jpg saved to cache
2025-12-04 10:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item ef50717b-454c-50b2-91b2-7aef0397fc2f
2025-12-04 10:07:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccfe0c10>
2025-12-04 10:07:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:07:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef50717b-454c-50b2-91b2-7aef0397fc2f/ef50717b-454c-50b2-91b2-7aef0397fc2f_image_16.jpg HTTP/1.1" 201 0
2025-12-04 10:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3692062-4007588-1002.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3692062-4007588-1002.jpg saved to cache
2025-12-04 10:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item ef50717b-454c-50b2-91b2-7aef0397fc2f
2025-12-04 10:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3691518-4006627-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003691518-01987696-002.pdf)
2025-12-04 10:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/MG/ZS?id=3663676&returnUrl=%2Fsearch%3FPage%3D4%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233663676&indx=326> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 10:07:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 10:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3692062-4007588-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003692062-01991320-002.pdf)
2025-12-04 10:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7007a6df-0b80-4ee6-88c4-80087bd44eb6_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003691518-01987696-002.pdf)
2025-12-04 10:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7007a6df-0b80-4ee6-88c4-80087bd44eb6_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003691518-01987696-002.pdf)
2025-12-04 10:07:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc698a50>
2025-12-04 10:07:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 10:07:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e001225-d64f-5536-ba30-8054d03fb6bb/8e001225-d64f-5536-ba30-8054d03fb6bb_image_14.jpg HTTP/1.1" 201 0
2025-12-04 10:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3691518-4006627-1000.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3691518-4006627-1000.jpg saved to cache
2025-12-04 10:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 8e001225-d64f-5536-ba30-8054d03fb6bb
2025-12-04 10:07:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccfccad0>
2025-12-04 10:07:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:07:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e001225-d64f-5536-ba30-8054d03fb6bb/8e001225-d64f-5536-ba30-8054d03fb6bb_image_15.jpg HTTP/1.1" 201 0
2025-12-04 10:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3691518-4006627-1001.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3691518-4006627-1001.jpg saved to cache
2025-12-04 10:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 8e001225-d64f-5536-ba30-8054d03fb6bb
2025-12-04 10:07:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccfffc90>
2025-12-04 10:07:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:07:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e001225-d64f-5536-ba30-8054d03fb6bb/8e001225-d64f-5536-ba30-8054d03fb6bb_image_19.jpg HTTP/1.1" 201 0
2025-12-04 10:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3691518-4006627-1005.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3691518-4006627-1005.jpg saved to cache
2025-12-04 10:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 8e001225-d64f-5536-ba30-8054d03fb6bb
2025-12-04 10:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3692062-4007588-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003692062-01991320-002.pdf)
2025-12-04 10:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3692062-4007588-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003692062-01991320-002.pdf)
2025-12-04 10:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7007a6df-0b80-4ee6-88c4-80087bd44eb6_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003691518-01987696-002.pdf)
2025-12-04 10:07:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd01ecd0>
2025-12-04 10:07:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:07:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e001225-d64f-5536-ba30-8054d03fb6bb/8e001225-d64f-5536-ba30-8054d03fb6bb_image_13.jpg HTTP/1.1" 201 0
2025-12-04 10:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3691518-4006627-13.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3691518-4006627-13.jpg saved to cache
2025-12-04 10:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 8e001225-d64f-5536-ba30-8054d03fb6bb
2025-12-04 10:07:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4636c780-bbcd-5551-98f2-5e4a1a292681 with identifier: 3663676
2025-12-04 10:07:25 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 4636c780-bbcd-5551-98f2-5e4a1a292681
2025-12-04 10:07:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6e62d0>
2025-12-04 10:07:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:07:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef50717b-454c-50b2-91b2-7aef0397fc2f/ef50717b-454c-50b2-91b2-7aef0397fc2f_image_14.jpg HTTP/1.1" 201 0
2025-12-04 10:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3692062-4007588-1000.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3692062-4007588-1000.jpg saved to cache
2025-12-04 10:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item ef50717b-454c-50b2-91b2-7aef0397fc2f
2025-12-04 10:07:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc7ef490>
2025-12-04 10:07:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:07:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e001225-d64f-5536-ba30-8054d03fb6bb/8e001225-d64f-5536-ba30-8054d03fb6bb_image_12.jpg HTTP/1.1" 201 0
2025-12-04 10:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7007a6df-0b80-4ee6-88c4-80087bd44eb6_ext_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7007a6df-0b80-4ee6-88c4-80087bd44eb6_ext_4.jpg saved to cache
2025-12-04 10:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 8e001225-d64f-5536-ba30-8054d03fb6bb
2025-12-04 10:07:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce90190>
2025-12-04 10:07:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:07:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e001225-d64f-5536-ba30-8054d03fb6bb/8e001225-d64f-5536-ba30-8054d03fb6bb_image_11.jpg HTTP/1.1" 201 0
2025-12-04 10:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7007a6df-0b80-4ee6-88c4-80087bd44eb6_ext_3.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7007a6df-0b80-4ee6-88c4-80087bd44eb6_ext_3.jpg saved to cache
2025-12-04 10:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 8e001225-d64f-5536-ba30-8054d03fb6bb
2025-12-04 10:07:26 [scrapy.extensions.logstats] INFO: Crawled 124 pages (at 24 pages/min), scraped 31 items (at 9 items/min)
2025-12-04 10:07:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VAUXHALL/GRANDLAND?id=3636928&returnUrl=%2Fsearch%3FPage%3D4%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233636928&indx=321> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 10:07:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/699f11a1-f464-4c0f-8e30-c0e59677185f_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003692062-01991320-002.pdf)
2025-12-04 10:07:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7007a6df-0b80-4ee6-88c4-80087bd44eb6_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003691518-01987696-002.pdf)
2025-12-04 10:07:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7007a6df-0b80-4ee6-88c4-80087bd44eb6_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003691518-01987696-002.pdf)
2025-12-04 10:07:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 10:07:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7007a6df-0b80-4ee6-88c4-80087bd44eb6_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003691518-01987696-002.pdf)
2025-12-04 10:07:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/699f11a1-f464-4c0f-8e30-c0e59677185f_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003692062-01991320-002.pdf)
2025-12-04 10:07:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/699f11a1-f464-4c0f-8e30-c0e59677185f_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003692062-01991320-002.pdf)
2025-12-04 10:07:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd678d0>
2025-12-04 10:07:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 10:07:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef50717b-454c-50b2-91b2-7aef0397fc2f/ef50717b-454c-50b2-91b2-7aef0397fc2f_image_15.jpg HTTP/1.1" 201 0
2025-12-04 10:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3692062-4007588-1001.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3692062-4007588-1001.jpg saved to cache
2025-12-04 10:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item ef50717b-454c-50b2-91b2-7aef0397fc2f
2025-12-04 10:07:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc58f250>
2025-12-04 10:07:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:07:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef50717b-454c-50b2-91b2-7aef0397fc2f/ef50717b-454c-50b2-91b2-7aef0397fc2f_image_13.jpg HTTP/1.1" 201 0
2025-12-04 10:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3692062-4007588-13.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3692062-4007588-13.jpg saved to cache
2025-12-04 10:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item ef50717b-454c-50b2-91b2-7aef0397fc2f
2025-12-04 10:07:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccce5f50>
2025-12-04 10:07:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:07:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e001225-d64f-5536-ba30-8054d03fb6bb/8e001225-d64f-5536-ba30-8054d03fb6bb_image_10.jpg HTTP/1.1" 201 0
2025-12-04 10:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7007a6df-0b80-4ee6-88c4-80087bd44eb6_ext_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7007a6df-0b80-4ee6-88c4-80087bd44eb6_ext_5.jpg saved to cache
2025-12-04 10:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 8e001225-d64f-5536-ba30-8054d03fb6bb
2025-12-04 10:07:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d8fbdd1-d49f-59e0-aed9-f3b12fa0b01a with identifier: 3636928
2025-12-04 10:07:28 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 8d8fbdd1-d49f-59e0-aed9-f3b12fa0b01a
2025-12-04 10:07:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6f9ad0>
2025-12-04 10:07:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:07:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef50717b-454c-50b2-91b2-7aef0397fc2f/ef50717b-454c-50b2-91b2-7aef0397fc2f_image_12.jpg HTTP/1.1" 201 0
2025-12-04 10:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F699f11a1-f464-4c0f-8e30-c0e59677185f_ext_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/699f11a1-f464-4c0f-8e30-c0e59677185f_ext_4.jpg saved to cache
2025-12-04 10:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item ef50717b-454c-50b2-91b2-7aef0397fc2f
2025-12-04 10:07:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6a75d0>
2025-12-04 10:07:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:07:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e001225-d64f-5536-ba30-8054d03fb6bb/8e001225-d64f-5536-ba30-8054d03fb6bb_image_8.jpg HTTP/1.1" 201 0
2025-12-04 10:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7007a6df-0b80-4ee6-88c4-80087bd44eb6_9.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7007a6df-0b80-4ee6-88c4-80087bd44eb6_9.jpg saved to cache
2025-12-04 10:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8e001225-d64f-5536-ba30-8054d03fb6bb
2025-12-04 10:07:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd11de90>
2025-12-04 10:07:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 10:07:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e001225-d64f-5536-ba30-8054d03fb6bb/8e001225-d64f-5536-ba30-8054d03fb6bb_image_7.jpg HTTP/1.1" 201 0
2025-12-04 10:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7007a6df-0b80-4ee6-88c4-80087bd44eb6_10.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7007a6df-0b80-4ee6-88c4-80087bd44eb6_10.jpg saved to cache
2025-12-04 10:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8e001225-d64f-5536-ba30-8054d03fb6bb
2025-12-04 10:07:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc61a490>
2025-12-04 10:07:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:07:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e001225-d64f-5536-ba30-8054d03fb6bb/8e001225-d64f-5536-ba30-8054d03fb6bb_image_9.jpg HTTP/1.1" 201 0
2025-12-04 10:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7007a6df-0b80-4ee6-88c4-80087bd44eb6_ext_2.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7007a6df-0b80-4ee6-88c4-80087bd44eb6_ext_2.jpg saved to cache
2025-12-04 10:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8e001225-d64f-5536-ba30-8054d03fb6bb
2025-12-04 10:07:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce2e350>
2025-12-04 10:07:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:07:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef50717b-454c-50b2-91b2-7aef0397fc2f/ef50717b-454c-50b2-91b2-7aef0397fc2f_image_11.jpg HTTP/1.1" 201 0
2025-12-04 10:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F699f11a1-f464-4c0f-8e30-c0e59677185f_ext_3.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/699f11a1-f464-4c0f-8e30-c0e59677185f_ext_3.jpg saved to cache
2025-12-04 10:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item ef50717b-454c-50b2-91b2-7aef0397fc2f
2025-12-04 10:07:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6a5d90>
2025-12-04 10:07:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:07:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef50717b-454c-50b2-91b2-7aef0397fc2f/ef50717b-454c-50b2-91b2-7aef0397fc2f_image_10.jpg HTTP/1.1" 201 0
2025-12-04 10:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F699f11a1-f464-4c0f-8e30-c0e59677185f_ext_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/699f11a1-f464-4c0f-8e30-c0e59677185f_ext_5.jpg saved to cache
2025-12-04 10:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item ef50717b-454c-50b2-91b2-7aef0397fc2f
2025-12-04 10:07:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/699f11a1-f464-4c0f-8e30-c0e59677185f_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003692062-01991320-002.pdf)
2025-12-04 10:07:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VAUXHALL/ASTRA?id=3633295&returnUrl=%2Fsearch%3FPage%3D4%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233633295&indx=319> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 10:07:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7007a6df-0b80-4ee6-88c4-80087bd44eb6_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003691518-01987696-002.pdf)
2025-12-04 10:07:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7007a6df-0b80-4ee6-88c4-80087bd44eb6_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003691518-01987696-002.pdf)
2025-12-04 10:07:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/699f11a1-f464-4c0f-8e30-c0e59677185f_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003692062-01991320-002.pdf)
2025-12-04 10:07:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7007a6df-0b80-4ee6-88c4-80087bd44eb6_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003691518-01987696-002.pdf)
2025-12-04 10:07:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/699f11a1-f464-4c0f-8e30-c0e59677185f_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003692062-01991320-002.pdf)
2025-12-04 10:07:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf86e50>
2025-12-04 10:07:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:07:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef50717b-454c-50b2-91b2-7aef0397fc2f/ef50717b-454c-50b2-91b2-7aef0397fc2f_image_9.jpg HTTP/1.1" 201 0
2025-12-04 10:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F699f11a1-f464-4c0f-8e30-c0e59677185f_ext_2.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/699f11a1-f464-4c0f-8e30-c0e59677185f_ext_2.jpg saved to cache
2025-12-04 10:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ef50717b-454c-50b2-91b2-7aef0397fc2f
2025-12-04 10:07:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003663676-01912248-003.pdf> (referer: None)
2025-12-04 10:07:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7007a6df-0b80-4ee6-88c4-80087bd44eb6_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003691518-01987696-002.pdf)
2025-12-04 10:07:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7007a6df-0b80-4ee6-88c4-80087bd44eb6_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003691518-01987696-002.pdf)
2025-12-04 10:07:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/699f11a1-f464-4c0f-8e30-c0e59677185f_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003692062-01991320-002.pdf)
2025-12-04 10:07:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/699f11a1-f464-4c0f-8e30-c0e59677185f_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003692062-01991320-002.pdf)
2025-12-04 10:07:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7007a6df-0b80-4ee6-88c4-80087bd44eb6_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003691518-01987696-002.pdf)
2025-12-04 10:07:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/699f11a1-f464-4c0f-8e30-c0e59677185f_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003692062-01991320-002.pdf)
2025-12-04 10:07:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0463889-3735-5d23-be4b-2f0c37bed253 with identifier: 3633295
2025-12-04 10:07:31 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item d0463889-3735-5d23-be4b-2f0c37bed253
2025-12-04 10:07:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccc83c10>
2025-12-04 10:07:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:07:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e001225-d64f-5536-ba30-8054d03fb6bb/8e001225-d64f-5536-ba30-8054d03fb6bb_image_5.jpg HTTP/1.1" 201 0
2025-12-04 10:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7007a6df-0b80-4ee6-88c4-80087bd44eb6_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7007a6df-0b80-4ee6-88c4-80087bd44eb6_4.jpg saved to cache
2025-12-04 10:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8e001225-d64f-5536-ba30-8054d03fb6bb
2025-12-04 10:07:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf5bd10>
2025-12-04 10:07:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:07:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e001225-d64f-5536-ba30-8054d03fb6bb/8e001225-d64f-5536-ba30-8054d03fb6bb_image_6.jpg HTTP/1.1" 201 0
2025-12-04 10:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7007a6df-0b80-4ee6-88c4-80087bd44eb6_11.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7007a6df-0b80-4ee6-88c4-80087bd44eb6_11.jpg saved to cache
2025-12-04 10:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8e001225-d64f-5536-ba30-8054d03fb6bb
2025-12-04 10:07:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc7c88d0>
2025-12-04 10:07:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:07:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef50717b-454c-50b2-91b2-7aef0397fc2f/ef50717b-454c-50b2-91b2-7aef0397fc2f_image_8.jpg HTTP/1.1" 201 0
2025-12-04 10:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F699f11a1-f464-4c0f-8e30-c0e59677185f_9.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/699f11a1-f464-4c0f-8e30-c0e59677185f_9.jpg saved to cache
2025-12-04 10:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ef50717b-454c-50b2-91b2-7aef0397fc2f
2025-12-04 10:07:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccfc3590>
2025-12-04 10:07:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:07:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e001225-d64f-5536-ba30-8054d03fb6bb/8e001225-d64f-5536-ba30-8054d03fb6bb_image_4.jpg HTTP/1.1" 201 0
2025-12-04 10:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7007a6df-0b80-4ee6-88c4-80087bd44eb6_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7007a6df-0b80-4ee6-88c4-80087bd44eb6_5.jpg saved to cache
2025-12-04 10:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8e001225-d64f-5536-ba30-8054d03fb6bb
2025-12-04 10:07:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd0f7050>
2025-12-04 10:07:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:07:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef50717b-454c-50b2-91b2-7aef0397fc2f/ef50717b-454c-50b2-91b2-7aef0397fc2f_image_7.jpg HTTP/1.1" 201 0
2025-12-04 10:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F699f11a1-f464-4c0f-8e30-c0e59677185f_10.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/699f11a1-f464-4c0f-8e30-c0e59677185f_10.jpg saved to cache
2025-12-04 10:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ef50717b-454c-50b2-91b2-7aef0397fc2f
2025-12-04 10:07:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=3634767&returnUrl=%2Fsearch%3FPage%3D4%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233634767&indx=320> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 10:07:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccfcd250>
2025-12-04 10:07:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:07:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4636c780-bbcd-5551-98f2-5e4a1a292681/4636c780-bbcd-5551-98f2-5e4a1a292681_expert_report_file_b9ec0c41-d6f6-4c5c-99bd-3f5680b59bda.pdf HTTP/1.1" 201 0
2025-12-04 10:07:33 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 4636c780-bbcd-5551-98f2-5e4a1a292681
2025-12-04 10:07:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4636c780-bbcd-5551-98f2-5e4a1a292681, skipping ID generation
2025-12-04 10:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 4636c780-bbcd-5551-98f2-5e4a1a292681
2025-12-04 10:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7ae472f9-ca0c-46f8-9eea-c544f124fdc3_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7ae472f9-ca0c-46f8-9eea-c544f124fdc3_ext_7.jpg already downloaded
2025-12-04 10:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7ae472f9-ca0c-46f8-9eea-c544f124fdc3_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7ae472f9-ca0c-46f8-9eea-c544f124fdc3_ext_7.jpg already downloaded
2025-12-04 10:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7ae472f9-ca0c-46f8-9eea-c544f124fdc3_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7ae472f9-ca0c-46f8-9eea-c544f124fdc3_ext_6.jpg already downloaded
2025-12-04 10:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7ae472f9-ca0c-46f8-9eea-c544f124fdc3_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7ae472f9-ca0c-46f8-9eea-c544f124fdc3_ext_1.jpg already downloaded
2025-12-04 10:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7ae472f9-ca0c-46f8-9eea-c544f124fdc3_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7ae472f9-ca0c-46f8-9eea-c544f124fdc3_5.jpg already downloaded
2025-12-04 10:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7ae472f9-ca0c-46f8-9eea-c544f124fdc3_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7ae472f9-ca0c-46f8-9eea-c544f124fdc3_4.jpg already downloaded
2025-12-04 10:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7ae472f9-ca0c-46f8-9eea-c544f124fdc3_11.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7ae472f9-ca0c-46f8-9eea-c544f124fdc3_11.jpg already downloaded
2025-12-04 10:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7ae472f9-ca0c-46f8-9eea-c544f124fdc3_10.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7ae472f9-ca0c-46f8-9eea-c544f124fdc3_10.jpg already downloaded
2025-12-04 10:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7ae472f9-ca0c-46f8-9eea-c544f124fdc3_9.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7ae472f9-ca0c-46f8-9eea-c544f124fdc3_9.jpg already downloaded
2025-12-04 10:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7ae472f9-ca0c-46f8-9eea-c544f124fdc3_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7ae472f9-ca0c-46f8-9eea-c544f124fdc3_ext_2.jpg already downloaded
2025-12-04 10:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7ae472f9-ca0c-46f8-9eea-c544f124fdc3_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7ae472f9-ca0c-46f8-9eea-c544f124fdc3_ext_5.jpg already downloaded
2025-12-04 10:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7ae472f9-ca0c-46f8-9eea-c544f124fdc3_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7ae472f9-ca0c-46f8-9eea-c544f124fdc3_ext_3.jpg already downloaded
2025-12-04 10:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7ae472f9-ca0c-46f8-9eea-c544f124fdc3_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7ae472f9-ca0c-46f8-9eea-c544f124fdc3_ext_4.jpg already downloaded
2025-12-04 10:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3663676-3987438-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3663676-3987438-13.jpg already downloaded
2025-12-04 10:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3663676-3987438-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3663676-3987438-1000.jpg already downloaded
2025-12-04 10:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3663676-3987438-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3663676-3987438-1001.jpg already downloaded
2025-12-04 10:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3663676-3987438-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3663676-3987438-1002.jpg already downloaded
2025-12-04 10:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3663676-3987438-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3663676-3987438-1003.jpg already downloaded
2025-12-04 10:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3663676-3987438-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3663676-3987438-1004.jpg already downloaded
2025-12-04 10:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3663676-3987438-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3663676-3987438-1005.jpg already downloaded
2025-12-04 10:07:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 4636c780-bbcd-5551-98f2-5e4a1a292681, identifier: 3663676
2025-12-04 10:07:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6a73d0>
2025-12-04 10:07:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:07:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e001225-d64f-5536-ba30-8054d03fb6bb/8e001225-d64f-5536-ba30-8054d03fb6bb_image_3.jpg HTTP/1.1" 201 0
2025-12-04 10:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7007a6df-0b80-4ee6-88c4-80087bd44eb6_ext_1.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7007a6df-0b80-4ee6-88c4-80087bd44eb6_ext_1.jpg saved to cache
2025-12-04 10:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8e001225-d64f-5536-ba30-8054d03fb6bb
2025-12-04 10:07:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5bf410>
2025-12-04 10:07:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:07:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e001225-d64f-5536-ba30-8054d03fb6bb/8e001225-d64f-5536-ba30-8054d03fb6bb_image_1.jpg HTTP/1.1" 201 0
2025-12-04 10:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7007a6df-0b80-4ee6-88c4-80087bd44eb6_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7007a6df-0b80-4ee6-88c4-80087bd44eb6_ext_7.jpg saved to cache
2025-12-04 10:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8e001225-d64f-5536-ba30-8054d03fb6bb
2025-12-04 10:07:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd83590>
2025-12-04 10:07:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:07:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef50717b-454c-50b2-91b2-7aef0397fc2f/ef50717b-454c-50b2-91b2-7aef0397fc2f_image_4.jpg HTTP/1.1" 201 0
2025-12-04 10:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F699f11a1-f464-4c0f-8e30-c0e59677185f_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/699f11a1-f464-4c0f-8e30-c0e59677185f_5.jpg saved to cache
2025-12-04 10:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ef50717b-454c-50b2-91b2-7aef0397fc2f
2025-12-04 10:07:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc64b8d0>
2025-12-04 10:07:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:07:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef50717b-454c-50b2-91b2-7aef0397fc2f/ef50717b-454c-50b2-91b2-7aef0397fc2f_image_6.jpg HTTP/1.1" 201 0
2025-12-04 10:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F699f11a1-f464-4c0f-8e30-c0e59677185f_11.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/699f11a1-f464-4c0f-8e30-c0e59677185f_11.jpg saved to cache
2025-12-04 10:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ef50717b-454c-50b2-91b2-7aef0397fc2f
2025-12-04 10:07:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce86050>
2025-12-04 10:07:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:07:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e001225-d64f-5536-ba30-8054d03fb6bb/8e001225-d64f-5536-ba30-8054d03fb6bb_image_2.jpg HTTP/1.1" 201 0
2025-12-04 10:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7007a6df-0b80-4ee6-88c4-80087bd44eb6_ext_6.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7007a6df-0b80-4ee6-88c4-80087bd44eb6_ext_6.jpg saved to cache
2025-12-04 10:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8e001225-d64f-5536-ba30-8054d03fb6bb
2025-12-04 10:07:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6a4090>
2025-12-04 10:07:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:07:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef50717b-454c-50b2-91b2-7aef0397fc2f/ef50717b-454c-50b2-91b2-7aef0397fc2f_image_5.jpg HTTP/1.1" 201 0
2025-12-04 10:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F699f11a1-f464-4c0f-8e30-c0e59677185f_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/699f11a1-f464-4c0f-8e30-c0e59677185f_4.jpg saved to cache
2025-12-04 10:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ef50717b-454c-50b2-91b2-7aef0397fc2f
2025-12-04 10:07:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 4636c780-bbcd-5551-98f2-5e4a1a292681 with identifier: 3663676
2025-12-04 10:07:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 4636c780-bbcd-5551-98f2-5e4a1a292681 with identifier: 3663676
2025-12-04 10:07:37 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 4636c780-bbcd-5551-98f2-5e4a1a292681 with identifier: 3663676 to the API
2025-12-04 10:07:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 10:07:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 10:07:38 [scrapy.core.scraper] DEBUG: Scraped from <200 http://ecr.manheim.co.uk/pdf/MOL-0003663676-01912248-003.pdf>
{'auction_title': '',
 'c_o_2_emission_value': 163,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4636c780-bbcd-5551-98f2-5e4a1a292681/4636c780-bbcd-5551-98f2-5e4a1a292681_expert_report_file_b9ec0c41-d6f6-4c5c-99bd-3f5680b59bda.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003663676-01912248-003.pdf',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '1.0L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '4636c780-bbcd-5551-98f2-5e4a1a292681',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'LB72EFE',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MG/ZS?id=3663676',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'MG',
 'model': 'ZS',
 'odometer': 23204,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 43,
 'photo_urls': ['http://images.manheim.co.uk/images/units/zoom/7ae472f9-ca0c-46f8-9eea-c544f124fdc3_ext_7.jpg',
                'http://images.manheim.co.uk/images/units/zoom/7ae472f9-ca0c-46f8-9eea-c544f124fdc3_ext_7.jpg',
                'http://images.manheim.co.uk/images/units/zoom/7ae472f9-ca0c-46f8-9eea-c544f124fdc3_ext_6.jpg',
                'http://images.manheim.co.uk/images/units/zoom/7ae472f9-ca0c-46f8-9eea-c544f124fdc3_ext_1.jpg',
                'http://images.manheim.co.uk/images/units/zoom/7ae472f9-ca0c-46f8-9eea-c544f124fdc3_5.jpg',
                'http://images.manheim.co.uk/images/units/zoom/7ae472f9-ca0c-46f8-9eea-c544f124fdc3_4.jpg',
                'http://images.manheim.co.uk/images/units/zoom/7ae472f9-ca0c-46f8-9eea-c544f124fdc3_11.jpg',
                'http://images.manheim.co.uk/images/units/zoom/7ae472f9-ca0c-46f8-9eea-c544f124fdc3_10.jpg',
                'http://images.manheim.co.uk/images/units/zoom/7ae472f9-ca0c-46f8-9eea-c544f124fdc3_9.jpg',
                'http://images.manheim.co.uk/images/units/zoom/7ae472f9-ca0c-46f8-9eea-c544f124fdc3_ext_2.jpg',
                'http://images.manheim.co.uk/images/units/zoom/7ae472f9-ca0c-46f8-9eea-c544f124fdc3_ext_5.jpg',
                'http://images.manheim.co.uk/images/units/zoom/7ae472f9-ca0c-46f8-9eea-c544f124fdc3_ext_3.jpg',
                'http://images.manheim.co.uk/images/units/zoom/7ae472f9-ca0c-46f8-9eea-c544f124fdc3_ext_4.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3663676-3987438-13.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3663676-3987438-1000.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3663676-3987438-1001.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3663676-3987438-1002.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3663676-3987438-1003.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3663676-3987438-1004.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3663676-3987438-1005.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4636c780-bbcd-5551-98f2-5e4a1a292681/4636c780-bbcd-5551-98f2-5e4a1a292681_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 213422,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7ae472f9-ca0c-46f8-9eea-c544f124fdc3_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4636c780-bbcd-5551-98f2-5e4a1a292681/4636c780-bbcd-5551-98f2-5e4a1a292681_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 213422,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7ae472f9-ca0c-46f8-9eea-c544f124fdc3_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4636c780-bbcd-5551-98f2-5e4a1a292681/4636c780-bbcd-5551-98f2-5e4a1a292681_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 312007,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7ae472f9-ca0c-46f8-9eea-c544f124fdc3_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4636c780-bbcd-5551-98f2-5e4a1a292681/4636c780-bbcd-5551-98f2-5e4a1a292681_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 137995,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7ae472f9-ca0c-46f8-9eea-c544f124fdc3_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4636c780-bbcd-5551-98f2-5e4a1a292681/4636c780-bbcd-5551-98f2-5e4a1a292681_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 193163,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7ae472f9-ca0c-46f8-9eea-c544f124fdc3_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4636c780-bbcd-5551-98f2-5e4a1a292681/4636c780-bbcd-5551-98f2-5e4a1a292681_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 187390,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7ae472f9-ca0c-46f8-9eea-c544f124fdc3_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4636c780-bbcd-5551-98f2-5e4a1a292681/4636c780-bbcd-5551-98f2-5e4a1a292681_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 192261,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7ae472f9-ca0c-46f8-9eea-c544f124fdc3_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4636c780-bbcd-5551-98f2-5e4a1a292681/4636c780-bbcd-5551-98f2-5e4a1a292681_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 181656,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7ae472f9-ca0c-46f8-9eea-c544f124fdc3_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4636c780-bbcd-5551-98f2-5e4a1a292681/4636c780-bbcd-5551-98f2-5e4a1a292681_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 211393,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7ae472f9-ca0c-46f8-9eea-c544f124fdc3_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4636c780-bbcd-5551-98f2-5e4a1a292681/4636c780-bbcd-5551-98f2-5e4a1a292681_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 300205,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7ae472f9-ca0c-46f8-9eea-c544f124fdc3_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4636c780-bbcd-5551-98f2-5e4a1a292681/4636c780-bbcd-5551-98f2-5e4a1a292681_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 262495,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7ae472f9-ca0c-46f8-9eea-c544f124fdc3_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4636c780-bbcd-5551-98f2-5e4a1a292681/4636c780-bbcd-5551-98f2-5e4a1a292681_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 264417,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7ae472f9-ca0c-46f8-9eea-c544f124fdc3_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4636c780-bbcd-5551-98f2-5e4a1a292681/4636c780-bbcd-5551-98f2-5e4a1a292681_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 208467,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7ae472f9-ca0c-46f8-9eea-c544f124fdc3_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4636c780-bbcd-5551-98f2-5e4a1a292681/4636c780-bbcd-5551-98f2-5e4a1a292681_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 401773,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3663676-3987438-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4636c780-bbcd-5551-98f2-5e4a1a292681/4636c780-bbcd-5551-98f2-5e4a1a292681_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 165345,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3663676-3987438-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4636c780-bbcd-5551-98f2-5e4a1a292681/4636c780-bbcd-5551-98f2-5e4a1a292681_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 270603,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3663676-3987438-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4636c780-bbcd-5551-98f2-5e4a1a292681/4636c780-bbcd-5551-98f2-5e4a1a292681_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 340887,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3663676-3987438-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4636c780-bbcd-5551-98f2-5e4a1a292681/4636c780-bbcd-5551-98f2-5e4a1a292681_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 322994,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3663676-3987438-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4636c780-bbcd-5551-98f2-5e4a1a292681/4636c780-bbcd-5551-98f2-5e4a1a292681_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 274053,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3663676-3987438-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4636c780-bbcd-5551-98f2-5e4a1a292681/4636c780-bbcd-5551-98f2-5e4a1a292681_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 331484,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3663676-3987438-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-31',
 'seller_name': 'Leasys',
 'title': 'MG ZS 1.0T GDi Excite 5dr DCT',
 'transmission': 'automatic',
 'trim': '1.0T GDi Excite 5dr DCT',
 'year': 2022}
2025-12-04 10:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273663676%27 HTTP/1.1" 200 None
2025-12-04 10:07:38 [manheim.gb] INFO: Saving data for 3663676: {'created_time': 1764842858.533064, 'last_price_update_time': 1764842858.533073, 'auction_closing_time': 1765270800.0}
2025-12-04 10:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3663676') HTTP/1.1" 204 0
2025-12-04 10:07:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=3684881&returnUrl=%2Fsearch%3FPage%3D4%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233684881&indx=336> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 10:07:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9945aa33-abc6-54b3-9bbd-4b873e292c5f with identifier: 3634767
2025-12-04 10:07:38 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 9945aa33-abc6-54b3-9bbd-4b873e292c5f
2025-12-04 10:07:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003636928-01884008-007.pdf> (referer: None)
2025-12-04 10:07:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003677202-01968493-004.pdf> (referer: None)
2025-12-04 10:07:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9284d511-d309-5f25-914b-ed90b8239ecf with identifier: 3684881
2025-12-04 10:07:38 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 9284d511-d309-5f25-914b-ed90b8239ecf
2025-12-04 10:07:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd0d98d0>
2025-12-04 10:07:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:07:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d8fbdd1-d49f-59e0-aed9-f3b12fa0b01a/8d8fbdd1-d49f-59e0-aed9-f3b12fa0b01a_expert_report_file_5a4744fd-53e7-4d1f-839f-ec1f2ce2078c.pdf HTTP/1.1" 201 0
2025-12-04 10:07:38 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 8d8fbdd1-d49f-59e0-aed9-f3b12fa0b01a
2025-12-04 10:07:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8d8fbdd1-d49f-59e0-aed9-f3b12fa0b01a, skipping ID generation
2025-12-04 10:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 19 photos for item 8d8fbdd1-d49f-59e0-aed9-f3b12fa0b01a
2025-12-04 10:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F965fa8d1-fc29-43dd-ba88-0f214c814e25_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/965fa8d1-fc29-43dd-ba88-0f214c814e25_ext_7.jpg already downloaded
2025-12-04 10:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F965fa8d1-fc29-43dd-ba88-0f214c814e25_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/965fa8d1-fc29-43dd-ba88-0f214c814e25_ext_7.jpg already downloaded
2025-12-04 10:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F965fa8d1-fc29-43dd-ba88-0f214c814e25_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/965fa8d1-fc29-43dd-ba88-0f214c814e25_ext_6.jpg already downloaded
2025-12-04 10:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F965fa8d1-fc29-43dd-ba88-0f214c814e25_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/965fa8d1-fc29-43dd-ba88-0f214c814e25_ext_1.jpg already downloaded
2025-12-04 10:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F965fa8d1-fc29-43dd-ba88-0f214c814e25_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/965fa8d1-fc29-43dd-ba88-0f214c814e25_5.jpg already downloaded
2025-12-04 10:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F965fa8d1-fc29-43dd-ba88-0f214c814e25_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/965fa8d1-fc29-43dd-ba88-0f214c814e25_4.jpg already downloaded
2025-12-04 10:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F965fa8d1-fc29-43dd-ba88-0f214c814e25_11.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/965fa8d1-fc29-43dd-ba88-0f214c814e25_11.jpg already downloaded
2025-12-04 10:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F965fa8d1-fc29-43dd-ba88-0f214c814e25_10.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/965fa8d1-fc29-43dd-ba88-0f214c814e25_10.jpg already downloaded
2025-12-04 10:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F965fa8d1-fc29-43dd-ba88-0f214c814e25_9.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/965fa8d1-fc29-43dd-ba88-0f214c814e25_9.jpg already downloaded
2025-12-04 10:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F965fa8d1-fc29-43dd-ba88-0f214c814e25_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/965fa8d1-fc29-43dd-ba88-0f214c814e25_ext_2.jpg already downloaded
2025-12-04 10:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F965fa8d1-fc29-43dd-ba88-0f214c814e25_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/965fa8d1-fc29-43dd-ba88-0f214c814e25_ext_5.jpg already downloaded
2025-12-04 10:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F965fa8d1-fc29-43dd-ba88-0f214c814e25_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/965fa8d1-fc29-43dd-ba88-0f214c814e25_ext_3.jpg already downloaded
2025-12-04 10:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F965fa8d1-fc29-43dd-ba88-0f214c814e25_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/965fa8d1-fc29-43dd-ba88-0f214c814e25_ext_4.jpg already downloaded
2025-12-04 10:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3636928-3876142-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3636928-3876142-13.jpg already downloaded
2025-12-04 10:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3636928-3876142-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3636928-3876142-1000.jpg already downloaded
2025-12-04 10:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3636928-3876142-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3636928-3876142-1001.jpg already downloaded
2025-12-04 10:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3636928-3876142-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3636928-3876142-1004.jpg already downloaded
2025-12-04 10:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3636928-3876142-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3636928-3876142-1005.jpg already downloaded
2025-12-04 10:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3636928-3876142-1006.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3636928-3876142-1006.jpg already downloaded
2025-12-04 10:07:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 8d8fbdd1-d49f-59e0-aed9-f3b12fa0b01a, identifier: 3636928
2025-12-04 10:07:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 8d8fbdd1-d49f-59e0-aed9-f3b12fa0b01a with identifier: 3636928
2025-12-04 10:07:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-04 10:07:39 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Petrol+PHEV HTTP/1.1" 200 None
2025-12-04 10:07:39 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-04 10:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-04 10:07:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 8d8fbdd1-d49f-59e0-aed9-f3b12fa0b01a with identifier: 3636928
2025-12-04 10:07:39 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 8d8fbdd1-d49f-59e0-aed9-f3b12fa0b01a with identifier: 3636928 to the API
2025-12-04 10:07:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 10:07:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 10:07:40 [scrapy.core.scraper] DEBUG: Scraped from <200 http://ecr.manheim.co.uk/pdf/MOL-0003636928-01884008-007.pdf>
{'auction_title': '',
 'c_o_2_emission_value': 27,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d8fbdd1-d49f-59e0-aed9-f3b12fa0b01a/8d8fbdd1-d49f-59e0-aed9-f3b12fa0b01a_expert_report_file_5a4744fd-53e7-4d1f-839f-ec1f2ce2078c.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003636928-01884008-007.pdf',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Petrol PHEV',
 'id': '8d8fbdd1-d49f-59e0-aed9-f3b12fa0b01a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'WF23BJJ',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VAUXHALL/GRANDLAND?id=3636928',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'VAUXHALL',
 'model': 'GRANDLAND',
 'odometer': 49139,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 19,
 'photo_urls': ['http://images.manheim.co.uk/images/units/zoom/965fa8d1-fc29-43dd-ba88-0f214c814e25_ext_7.jpg',
                'http://images.manheim.co.uk/images/units/zoom/965fa8d1-fc29-43dd-ba88-0f214c814e25_ext_7.jpg',
                'http://images.manheim.co.uk/images/units/zoom/965fa8d1-fc29-43dd-ba88-0f214c814e25_ext_6.jpg',
                'http://images.manheim.co.uk/images/units/zoom/965fa8d1-fc29-43dd-ba88-0f214c814e25_ext_1.jpg',
                'http://images.manheim.co.uk/images/units/zoom/965fa8d1-fc29-43dd-ba88-0f214c814e25_5.jpg',
                'http://images.manheim.co.uk/images/units/zoom/965fa8d1-fc29-43dd-ba88-0f214c814e25_4.jpg',
                'http://images.manheim.co.uk/images/units/zoom/965fa8d1-fc29-43dd-ba88-0f214c814e25_11.jpg',
                'http://images.manheim.co.uk/images/units/zoom/965fa8d1-fc29-43dd-ba88-0f214c814e25_10.jpg',
                'http://images.manheim.co.uk/images/units/zoom/965fa8d1-fc29-43dd-ba88-0f214c814e25_9.jpg',
                'http://images.manheim.co.uk/images/units/zoom/965fa8d1-fc29-43dd-ba88-0f214c814e25_ext_2.jpg',
                'http://images.manheim.co.uk/images/units/zoom/965fa8d1-fc29-43dd-ba88-0f214c814e25_ext_5.jpg',
                'http://images.manheim.co.uk/images/units/zoom/965fa8d1-fc29-43dd-ba88-0f214c814e25_ext_3.jpg',
                'http://images.manheim.co.uk/images/units/zoom/965fa8d1-fc29-43dd-ba88-0f214c814e25_ext_4.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3636928-3876142-13.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3636928-3876142-1000.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3636928-3876142-1001.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3636928-3876142-1004.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3636928-3876142-1005.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3636928-3876142-1006.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d8fbdd1-d49f-59e0-aed9-f3b12fa0b01a/8d8fbdd1-d49f-59e0-aed9-f3b12fa0b01a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 187059,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/965fa8d1-fc29-43dd-ba88-0f214c814e25_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d8fbdd1-d49f-59e0-aed9-f3b12fa0b01a/8d8fbdd1-d49f-59e0-aed9-f3b12fa0b01a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 187059,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/965fa8d1-fc29-43dd-ba88-0f214c814e25_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d8fbdd1-d49f-59e0-aed9-f3b12fa0b01a/8d8fbdd1-d49f-59e0-aed9-f3b12fa0b01a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 249732,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/965fa8d1-fc29-43dd-ba88-0f214c814e25_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d8fbdd1-d49f-59e0-aed9-f3b12fa0b01a/8d8fbdd1-d49f-59e0-aed9-f3b12fa0b01a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 159799,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/965fa8d1-fc29-43dd-ba88-0f214c814e25_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d8fbdd1-d49f-59e0-aed9-f3b12fa0b01a/8d8fbdd1-d49f-59e0-aed9-f3b12fa0b01a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 183106,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/965fa8d1-fc29-43dd-ba88-0f214c814e25_5.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d8fbdd1-d49f-59e0-aed9-f3b12fa0b01a/8d8fbdd1-d49f-59e0-aed9-f3b12fa0b01a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 174995,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/965fa8d1-fc29-43dd-ba88-0f214c814e25_4.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d8fbdd1-d49f-59e0-aed9-f3b12fa0b01a/8d8fbdd1-d49f-59e0-aed9-f3b12fa0b01a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 184711,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/965fa8d1-fc29-43dd-ba88-0f214c814e25_11.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d8fbdd1-d49f-59e0-aed9-f3b12fa0b01a/8d8fbdd1-d49f-59e0-aed9-f3b12fa0b01a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 176321,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/965fa8d1-fc29-43dd-ba88-0f214c814e25_10.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d8fbdd1-d49f-59e0-aed9-f3b12fa0b01a/8d8fbdd1-d49f-59e0-aed9-f3b12fa0b01a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 187532,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/965fa8d1-fc29-43dd-ba88-0f214c814e25_9.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d8fbdd1-d49f-59e0-aed9-f3b12fa0b01a/8d8fbdd1-d49f-59e0-aed9-f3b12fa0b01a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 283407,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/965fa8d1-fc29-43dd-ba88-0f214c814e25_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d8fbdd1-d49f-59e0-aed9-f3b12fa0b01a/8d8fbdd1-d49f-59e0-aed9-f3b12fa0b01a_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 199949,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/965fa8d1-fc29-43dd-ba88-0f214c814e25_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d8fbdd1-d49f-59e0-aed9-f3b12fa0b01a/8d8fbdd1-d49f-59e0-aed9-f3b12fa0b01a_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 243125,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/965fa8d1-fc29-43dd-ba88-0f214c814e25_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d8fbdd1-d49f-59e0-aed9-f3b12fa0b01a/8d8fbdd1-d49f-59e0-aed9-f3b12fa0b01a_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 260950,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/965fa8d1-fc29-43dd-ba88-0f214c814e25_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d8fbdd1-d49f-59e0-aed9-f3b12fa0b01a/8d8fbdd1-d49f-59e0-aed9-f3b12fa0b01a_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 323982,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3636928-3876142-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d8fbdd1-d49f-59e0-aed9-f3b12fa0b01a/8d8fbdd1-d49f-59e0-aed9-f3b12fa0b01a_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 420428,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3636928-3876142-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d8fbdd1-d49f-59e0-aed9-f3b12fa0b01a/8d8fbdd1-d49f-59e0-aed9-f3b12fa0b01a_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 233877,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3636928-3876142-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d8fbdd1-d49f-59e0-aed9-f3b12fa0b01a/8d8fbdd1-d49f-59e0-aed9-f3b12fa0b01a_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 301460,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3636928-3876142-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d8fbdd1-d49f-59e0-aed9-f3b12fa0b01a/8d8fbdd1-d49f-59e0-aed9-f3b12fa0b01a_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 171853,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3636928-3876142-1005.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d8fbdd1-d49f-59e0-aed9-f3b12fa0b01a/8d8fbdd1-d49f-59e0-aed9-f3b12fa0b01a_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 126465,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3636928-3876142-1006.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-23',
 'seller_name': 'Vauxhall Motors Limited',
 'title': 'VAUXHALL GRANDLAND 1.6 Plug-in Hybrid [300] 4X4 GSe 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.6 Plug-in Hybrid [300] 4X4 GSe 5dr Auto',
 'year': 2023}
2025-12-04 10:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273636928%27 HTTP/1.1" 200 None
2025-12-04 10:07:40 [manheim.gb] INFO: Saving data for 3636928: {'created_time': 1764842860.233452, 'last_price_update_time': 1764842860.233466, 'auction_closing_time': 1765270800.0}
2025-12-04 10:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3636928') HTTP/1.1" 204 0
2025-12-04 10:07:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3693298-3631035-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003693298-1001400926-002.pdf)
2025-12-04 10:07:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3693298-3631035-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003693298-1001400926-002.pdf)
2025-12-04 10:07:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc570810>
2025-12-04 10:07:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2fbbc445-b915-58e2-ba7a-9c92dc3e12e7/2fbbc445-b915-58e2-ba7a-9c92dc3e12e7_expert_report_file_f3d957b0-8c9d-464d-ad61-a89cc51978e2.pdf HTTP/1.1" 201 0
2025-12-04 10:07:40 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 2fbbc445-b915-58e2-ba7a-9c92dc3e12e7
2025-12-04 10:07:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2fbbc445-b915-58e2-ba7a-9c92dc3e12e7, skipping ID generation
2025-12-04 10:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 2fbbc445-b915-58e2-ba7a-9c92dc3e12e7
2025-12-04 10:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F03307b7a-75ba-4386-ba32-131489a9974d_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/03307b7a-75ba-4386-ba32-131489a9974d_ext_7.jpg not downloaded yet
2025-12-04 10:07:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3693298-3631035-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003693298-1001400926-002.pdf)
2025-12-04 10:07:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7007a6df-0b80-4ee6-88c4-80087bd44eb6_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003691518-01987696-002.pdf)
2025-12-04 10:07:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/699f11a1-f464-4c0f-8e30-c0e59677185f_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003692062-01991320-002.pdf)
2025-12-04 10:07:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/699f11a1-f464-4c0f-8e30-c0e59677185f_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003692062-01991320-002.pdf)
2025-12-04 10:07:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/699f11a1-f464-4c0f-8e30-c0e59677185f_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003692062-01991320-002.pdf)
2025-12-04 10:07:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/699f11a1-f464-4c0f-8e30-c0e59677185f_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003692062-01991320-002.pdf)
2025-12-04 10:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F03307b7a-75ba-4386-ba32-131489a9974d_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/03307b7a-75ba-4386-ba32-131489a9974d_ext_7.jpg not downloaded yet
2025-12-04 10:07:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd0a0dd0>
2025-12-04 10:07:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df58e7f8-61e7-56dd-9423-3b35c4acd52f/df58e7f8-61e7-56dd-9423-3b35c4acd52f_image_16.jpg HTTP/1.1" 201 0
2025-12-04 10:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3693298-3631035-1002.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3693298-3631035-1002.jpg saved to cache
2025-12-04 10:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item df58e7f8-61e7-56dd-9423-3b35c4acd52f
2025-12-04 10:07:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccc5cc50>
2025-12-04 10:07:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:07:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df58e7f8-61e7-56dd-9423-3b35c4acd52f/df58e7f8-61e7-56dd-9423-3b35c4acd52f_image_19.jpg HTTP/1.1" 201 0
2025-12-04 10:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3693298-3631035-1005.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3693298-3631035-1005.jpg saved to cache
2025-12-04 10:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item df58e7f8-61e7-56dd-9423-3b35c4acd52f
2025-12-04 10:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003633295-01970529-004.pdf> (referer: None)
2025-12-04 10:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F03307b7a-75ba-4386-ba32-131489a9974d_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/03307b7a-75ba-4386-ba32-131489a9974d_ext_6.jpg not downloaded yet
2025-12-04 10:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F03307b7a-75ba-4386-ba32-131489a9974d_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/03307b7a-75ba-4386-ba32-131489a9974d_ext_1.jpg not downloaded yet
2025-12-04 10:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F03307b7a-75ba-4386-ba32-131489a9974d_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/03307b7a-75ba-4386-ba32-131489a9974d_5.jpg not downloaded yet
2025-12-04 10:07:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd009f10>
2025-12-04 10:07:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:07:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df58e7f8-61e7-56dd-9423-3b35c4acd52f/df58e7f8-61e7-56dd-9423-3b35c4acd52f_image_18.jpg HTTP/1.1" 201 0
2025-12-04 10:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3693298-3631035-1004.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3693298-3631035-1004.jpg saved to cache
2025-12-04 10:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item df58e7f8-61e7-56dd-9423-3b35c4acd52f
2025-12-04 10:07:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce13290>
2025-12-04 10:07:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:07:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e001225-d64f-5536-ba30-8054d03fb6bb/8e001225-d64f-5536-ba30-8054d03fb6bb_image_0.jpg HTTP/1.1" 201 0
2025-12-04 10:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7007a6df-0b80-4ee6-88c4-80087bd44eb6_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7007a6df-0b80-4ee6-88c4-80087bd44eb6_ext_7.jpg saved to cache
2025-12-04 10:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8e001225-d64f-5536-ba30-8054d03fb6bb
2025-12-04 10:07:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8e001225-d64f-5536-ba30-8054d03fb6bb, skipping ID generation
2025-12-04 10:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 8e001225-d64f-5536-ba30-8054d03fb6bb from tracking dictionaries
2025-12-04 10:07:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8e001225-d64f-5536-ba30-8054d03fb6bb sending to next pipeline
2025-12-04 10:07:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 8e001225-d64f-5536-ba30-8054d03fb6bb, identifier: 3691518
2025-12-04 10:07:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5f6a10>
2025-12-04 10:07:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:07:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef50717b-454c-50b2-91b2-7aef0397fc2f/ef50717b-454c-50b2-91b2-7aef0397fc2f_image_1.jpg HTTP/1.1" 201 0
2025-12-04 10:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F699f11a1-f464-4c0f-8e30-c0e59677185f_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/699f11a1-f464-4c0f-8e30-c0e59677185f_ext_7.jpg saved to cache
2025-12-04 10:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ef50717b-454c-50b2-91b2-7aef0397fc2f
2025-12-04 10:07:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5c3a90>
2025-12-04 10:07:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:07:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef50717b-454c-50b2-91b2-7aef0397fc2f/ef50717b-454c-50b2-91b2-7aef0397fc2f_image_3.jpg HTTP/1.1" 201 0
2025-12-04 10:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F699f11a1-f464-4c0f-8e30-c0e59677185f_ext_1.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/699f11a1-f464-4c0f-8e30-c0e59677185f_ext_1.jpg saved to cache
2025-12-04 10:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ef50717b-454c-50b2-91b2-7aef0397fc2f
2025-12-04 10:07:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf90790>
2025-12-04 10:07:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:07:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef50717b-454c-50b2-91b2-7aef0397fc2f/ef50717b-454c-50b2-91b2-7aef0397fc2f_image_2.jpg HTTP/1.1" 201 0
2025-12-04 10:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F699f11a1-f464-4c0f-8e30-c0e59677185f_ext_6.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/699f11a1-f464-4c0f-8e30-c0e59677185f_ext_6.jpg saved to cache
2025-12-04 10:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ef50717b-454c-50b2-91b2-7aef0397fc2f
2025-12-04 10:07:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf318d0>
2025-12-04 10:07:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:07:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef50717b-454c-50b2-91b2-7aef0397fc2f/ef50717b-454c-50b2-91b2-7aef0397fc2f_image_0.jpg HTTP/1.1" 201 0
2025-12-04 10:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F699f11a1-f464-4c0f-8e30-c0e59677185f_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/699f11a1-f464-4c0f-8e30-c0e59677185f_ext_7.jpg saved to cache
2025-12-04 10:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ef50717b-454c-50b2-91b2-7aef0397fc2f
2025-12-04 10:07:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ef50717b-454c-50b2-91b2-7aef0397fc2f, skipping ID generation
2025-12-04 10:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Removing item ef50717b-454c-50b2-91b2-7aef0397fc2f from tracking dictionaries
2025-12-04 10:07:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ef50717b-454c-50b2-91b2-7aef0397fc2f sending to next pipeline
2025-12-04 10:07:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: ef50717b-454c-50b2-91b2-7aef0397fc2f, identifier: 3692062
2025-12-04 10:07:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 8e001225-d64f-5536-ba30-8054d03fb6bb with identifier: 3691518
2025-12-04 10:07:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 8e001225-d64f-5536-ba30-8054d03fb6bb with identifier: 3691518
2025-12-04 10:07:43 [scrapy.core.scraper] INFO: Dropped: Dropping expired listing: 8e001225-d64f-5536-ba30-8054d03fb6bb with expiration date: 2025-12-04T09:00:00Z
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e001225-d64f-5536-ba30-8054d03fb6bb/8e001225-d64f-5536-ba30-8054d03fb6bb_expert_report_file_076dee40-596d-40ef-8192-c27d4300afd8.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003691518-01987696-002.pdf',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '8e001225-d64f-5536-ba30-8054d03fb6bb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'GC17WEV',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/KIA/RIO?id=3691518',
 'listing': 'auction',
 'location': 'Leeds',
 'make': 'KIA',
 'model': 'RIO',
 'odometer': 59455,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 38,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e001225-d64f-5536-ba30-8054d03fb6bb/8e001225-d64f-5536-ba30-8054d03fb6bb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 209456,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7007a6df-0b80-4ee6-88c4-80087bd44eb6_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e001225-d64f-5536-ba30-8054d03fb6bb/8e001225-d64f-5536-ba30-8054d03fb6bb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 209456,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7007a6df-0b80-4ee6-88c4-80087bd44eb6_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e001225-d64f-5536-ba30-8054d03fb6bb/8e001225-d64f-5536-ba30-8054d03fb6bb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 243821,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7007a6df-0b80-4ee6-88c4-80087bd44eb6_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e001225-d64f-5536-ba30-8054d03fb6bb/8e001225-d64f-5536-ba30-8054d03fb6bb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 194715,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7007a6df-0b80-4ee6-88c4-80087bd44eb6_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e001225-d64f-5536-ba30-8054d03fb6bb/8e001225-d64f-5536-ba30-8054d03fb6bb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 202270,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7007a6df-0b80-4ee6-88c4-80087bd44eb6_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e001225-d64f-5536-ba30-8054d03fb6bb/8e001225-d64f-5536-ba30-8054d03fb6bb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 184215,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7007a6df-0b80-4ee6-88c4-80087bd44eb6_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e001225-d64f-5536-ba30-8054d03fb6bb/8e001225-d64f-5536-ba30-8054d03fb6bb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 198064,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7007a6df-0b80-4ee6-88c4-80087bd44eb6_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e001225-d64f-5536-ba30-8054d03fb6bb/8e001225-d64f-5536-ba30-8054d03fb6bb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 178184,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7007a6df-0b80-4ee6-88c4-80087bd44eb6_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e001225-d64f-5536-ba30-8054d03fb6bb/8e001225-d64f-5536-ba30-8054d03fb6bb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 194808,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7007a6df-0b80-4ee6-88c4-80087bd44eb6_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e001225-d64f-5536-ba30-8054d03fb6bb/8e001225-d64f-5536-ba30-8054d03fb6bb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 249914,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7007a6df-0b80-4ee6-88c4-80087bd44eb6_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e001225-d64f-5536-ba30-8054d03fb6bb/8e001225-d64f-5536-ba30-8054d03fb6bb_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 221991,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7007a6df-0b80-4ee6-88c4-80087bd44eb6_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e001225-d64f-5536-ba30-8054d03fb6bb/8e001225-d64f-5536-ba30-8054d03fb6bb_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 220236,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7007a6df-0b80-4ee6-88c4-80087bd44eb6_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e001225-d64f-5536-ba30-8054d03fb6bb/8e001225-d64f-5536-ba30-8054d03fb6bb_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 216825,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7007a6df-0b80-4ee6-88c4-80087bd44eb6_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e001225-d64f-5536-ba30-8054d03fb6bb/8e001225-d64f-5536-ba30-8054d03fb6bb_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 331249,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3691518-4006627-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e001225-d64f-5536-ba30-8054d03fb6bb/8e001225-d64f-5536-ba30-8054d03fb6bb_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 302106,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3691518-4006627-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e001225-d64f-5536-ba30-8054d03fb6bb/8e001225-d64f-5536-ba30-8054d03fb6bb_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 371420,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3691518-4006627-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e001225-d64f-5536-ba30-8054d03fb6bb/8e001225-d64f-5536-ba30-8054d03fb6bb_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110402,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3691518-4006627-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e001225-d64f-5536-ba30-8054d03fb6bb/8e001225-d64f-5536-ba30-8054d03fb6bb_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 154537,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3691518-4006627-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e001225-d64f-5536-ba30-8054d03fb6bb/8e001225-d64f-5536-ba30-8054d03fb6bb_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 189743,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3691518-4006627-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e001225-d64f-5536-ba30-8054d03fb6bb/8e001225-d64f-5536-ba30-8054d03fb6bb_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 387202,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3691518-4006627-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-18',
 'seller_name': 'Pentagon Group',
 'title': 'KIA RIO 1.25 Pulse 5dr',
 'transmission': 'manual',
 'trim': '1.25 Pulse 5dr',
 'year': 2017}
2025-12-04 10:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273691518%27 HTTP/1.1" 200 None
2025-12-04 10:07:43 [manheim.gb] INFO: Saving data for 3691518: {'created_time': 1764842863.53383, 'last_price_update_time': 1764842863.533842, 'auction_closing_time': 1764838800.0}
2025-12-04 10:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3691518') HTTP/1.1" 204 0
2025-12-04 10:07:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: ef50717b-454c-50b2-91b2-7aef0397fc2f with identifier: 3692062
2025-12-04 10:07:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: ef50717b-454c-50b2-91b2-7aef0397fc2f with identifier: 3692062
2025-12-04 10:07:43 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: ef50717b-454c-50b2-91b2-7aef0397fc2f with identifier: 3692062 to the API
2025-12-04 10:07:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 10:07:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 10:07:43 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/699f11a1-f464-4c0f-8e30-c0e59677185f_ext_7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef50717b-454c-50b2-91b2-7aef0397fc2f/ef50717b-454c-50b2-91b2-7aef0397fc2f_expert_report_file_7cbeb372-c0a3-420b-8496-99169e264739.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003692062-01991320-002.pdf',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '1.5L',
 'expiration_date': '2025-12-10T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'ef50717b-454c-50b2-91b2-7aef0397fc2f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'SJ19PWD',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=3692062',
 'listing': 'auction',
 'location': 'Plymouth',
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 92701,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 35,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef50717b-454c-50b2-91b2-7aef0397fc2f/ef50717b-454c-50b2-91b2-7aef0397fc2f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 230759,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/699f11a1-f464-4c0f-8e30-c0e59677185f_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef50717b-454c-50b2-91b2-7aef0397fc2f/ef50717b-454c-50b2-91b2-7aef0397fc2f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 230759,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/699f11a1-f464-4c0f-8e30-c0e59677185f_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef50717b-454c-50b2-91b2-7aef0397fc2f/ef50717b-454c-50b2-91b2-7aef0397fc2f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 259952,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/699f11a1-f464-4c0f-8e30-c0e59677185f_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef50717b-454c-50b2-91b2-7aef0397fc2f/ef50717b-454c-50b2-91b2-7aef0397fc2f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 261534,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/699f11a1-f464-4c0f-8e30-c0e59677185f_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef50717b-454c-50b2-91b2-7aef0397fc2f/ef50717b-454c-50b2-91b2-7aef0397fc2f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 230822,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/699f11a1-f464-4c0f-8e30-c0e59677185f_5.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef50717b-454c-50b2-91b2-7aef0397fc2f/ef50717b-454c-50b2-91b2-7aef0397fc2f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 226106,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/699f11a1-f464-4c0f-8e30-c0e59677185f_4.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef50717b-454c-50b2-91b2-7aef0397fc2f/ef50717b-454c-50b2-91b2-7aef0397fc2f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 224844,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/699f11a1-f464-4c0f-8e30-c0e59677185f_11.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef50717b-454c-50b2-91b2-7aef0397fc2f/ef50717b-454c-50b2-91b2-7aef0397fc2f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 214852,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/699f11a1-f464-4c0f-8e30-c0e59677185f_10.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef50717b-454c-50b2-91b2-7aef0397fc2f/ef50717b-454c-50b2-91b2-7aef0397fc2f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 227787,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/699f11a1-f464-4c0f-8e30-c0e59677185f_9.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef50717b-454c-50b2-91b2-7aef0397fc2f/ef50717b-454c-50b2-91b2-7aef0397fc2f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 263521,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/699f11a1-f464-4c0f-8e30-c0e59677185f_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef50717b-454c-50b2-91b2-7aef0397fc2f/ef50717b-454c-50b2-91b2-7aef0397fc2f_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 258515,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/699f11a1-f464-4c0f-8e30-c0e59677185f_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef50717b-454c-50b2-91b2-7aef0397fc2f/ef50717b-454c-50b2-91b2-7aef0397fc2f_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 259299,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/699f11a1-f464-4c0f-8e30-c0e59677185f_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef50717b-454c-50b2-91b2-7aef0397fc2f/ef50717b-454c-50b2-91b2-7aef0397fc2f_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 194334,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/699f11a1-f464-4c0f-8e30-c0e59677185f_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef50717b-454c-50b2-91b2-7aef0397fc2f/ef50717b-454c-50b2-91b2-7aef0397fc2f_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 370892,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3692062-4007588-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef50717b-454c-50b2-91b2-7aef0397fc2f/ef50717b-454c-50b2-91b2-7aef0397fc2f_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 196713,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3692062-4007588-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef50717b-454c-50b2-91b2-7aef0397fc2f/ef50717b-454c-50b2-91b2-7aef0397fc2f_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 377469,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3692062-4007588-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef50717b-454c-50b2-91b2-7aef0397fc2f/ef50717b-454c-50b2-91b2-7aef0397fc2f_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 207570,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3692062-4007588-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef50717b-454c-50b2-91b2-7aef0397fc2f/ef50717b-454c-50b2-91b2-7aef0397fc2f_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 149233,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3692062-4007588-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef50717b-454c-50b2-91b2-7aef0397fc2f/ef50717b-454c-50b2-91b2-7aef0397fc2f_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 162695,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3692062-4007588-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef50717b-454c-50b2-91b2-7aef0397fc2f/ef50717b-454c-50b2-91b2-7aef0397fc2f_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 129318,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3692062-4007588-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-31',
 'seller_name': 'Yeomans',
 'title': 'NISSAN QASHQAI 1.5 dCi 115 N-Connecta 5dr',
 'transmission': 'manual',
 'trim': '1.5 dCi 115 N-Connecta 5dr',
 'year': 2019}
2025-12-04 10:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273692062%27 HTTP/1.1" 200 None
2025-12-04 10:07:43 [manheim.gb] INFO: Saving data for 3692062: {'created_time': 1764842863.974296, 'last_price_update_time': 1764842863.97431, 'auction_closing_time': 1765357200.0}
2025-12-04 10:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3692062') HTTP/1.1" 204 0
2025-12-04 10:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F03307b7a-75ba-4386-ba32-131489a9974d_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/03307b7a-75ba-4386-ba32-131489a9974d_4.jpg not downloaded yet
2025-12-04 10:07:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=3630205&returnUrl=%2Fsearch%3FPage%3D4%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233630205&indx=318> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 10:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F03307b7a-75ba-4386-ba32-131489a9974d_11.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/03307b7a-75ba-4386-ba32-131489a9974d_11.jpg not downloaded yet
2025-12-04 10:07:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc7eed90>
2025-12-04 10:07:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:07:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0463889-3735-5d23-be4b-2f0c37bed253/d0463889-3735-5d23-be4b-2f0c37bed253_expert_report_file_35349679-a6c2-494c-9744-d8f9f7949084.pdf HTTP/1.1" 201 0
2025-12-04 10:07:44 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item d0463889-3735-5d23-be4b-2f0c37bed253
2025-12-04 10:07:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d0463889-3735-5d23-be4b-2f0c37bed253, skipping ID generation
2025-12-04 10:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 14 photos for item d0463889-3735-5d23-be4b-2f0c37bed253
2025-12-04 10:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_7.jpg already downloaded
2025-12-04 10:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_7.jpg already downloaded
2025-12-04 10:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_6.jpg already downloaded
2025-12-04 10:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_1.jpg already downloaded
2025-12-04 10:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F34621b69-ed7d-422a-ad67-861f0dc98ca4_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_5.jpg already downloaded
2025-12-04 10:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F34621b69-ed7d-422a-ad67-861f0dc98ca4_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_4.jpg already downloaded
2025-12-04 10:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F34621b69-ed7d-422a-ad67-861f0dc98ca4_11.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_11.jpg already downloaded
2025-12-04 10:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F34621b69-ed7d-422a-ad67-861f0dc98ca4_10.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_10.jpg already downloaded
2025-12-04 10:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F34621b69-ed7d-422a-ad67-861f0dc98ca4_9.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_9.jpg already downloaded
2025-12-04 10:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_2.jpg already downloaded
2025-12-04 10:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_5.jpg already downloaded
2025-12-04 10:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_3.jpg already downloaded
2025-12-04 10:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_4.jpg already downloaded
2025-12-04 10:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3633295-3980370-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3633295-3980370-13.jpg already downloaded
2025-12-04 10:07:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: d0463889-3735-5d23-be4b-2f0c37bed253, identifier: 3633295
2025-12-04 10:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F03307b7a-75ba-4386-ba32-131489a9974d_10.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/03307b7a-75ba-4386-ba32-131489a9974d_10.jpg not downloaded yet
2025-12-04 10:07:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: d0463889-3735-5d23-be4b-2f0c37bed253 with identifier: 3633295
2025-12-04 10:07:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-04 10:07:44 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=White HTTP/1.1" 200 None
2025-12-04 10:07:44 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-04 10:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-04 10:07:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: d0463889-3735-5d23-be4b-2f0c37bed253 with identifier: 3633295
2025-12-04 10:07:45 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 14, 'seller_name': 'vauxhall motors limited', 'price_includes_vat': False, 'title': 'vauxhall astra 115kw gs 54kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'vauxhall', 'model': 'astra', 'transmission': 'automatic', 'engine': '0.0l', 'fuel_type': 'electric', 'odometer': 3807, 'odometer_reading_unit': 'mi', 'registration_date': '2024-02-28', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/vauxhall/astra?id=3633295', 'location': 'colchester', 'origin_country_code': 'gb', 'trim': '115kw gs 54kwh 5dr auto', 'license_plate': 'fm73hge', 'year': 2024, 'listing': 'auction', 'c_o_2_emission_value': 0, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0003633295-01970529-004.pdf', 'expiration_date': '2025-12-09t09:00:00z', 'is_vat_deductible': True, 'is_vat_included': False, 'photo_urls': ['http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_7.jpg', 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_7.jpg', 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_6.jpg', 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_1.jpg', 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_5.jpg', 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_4.jpg', 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_11.jpg', 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_10.jpg', 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_9.jpg', 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_2.jpg', 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_5.jpg', 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_3.jpg', 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_4.jpg', 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3633295-3980370-13.jpg'], 'id': 'd0463889-3735-5d23-be4b-2f0c37bed253', 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0463889-3735-5d23-be4b-2f0c37bed253/d0463889-3735-5d23-be4b-2f0c37bed253_expert_report_file_35349679-a6c2-494c-9744-d8f9f7949084.pdf', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0463889-3735-5d23-be4b-2f0c37bed253/d0463889-3735-5d23-be4b-2f0c37bed253_image_1.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_7.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 219920}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0463889-3735-5d23-be4b-2f0c37bed253/d0463889-3735-5d23-be4b-2f0c37bed253_image_1.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_7.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 219920}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0463889-3735-5d23-be4b-2f0c37bed253/d0463889-3735-5d23-be4b-2f0c37bed253_image_2.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_6.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 203854}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0463889-3735-5d23-be4b-2f0c37bed253/d0463889-3735-5d23-be4b-2f0c37bed253_image_3.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_1.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 125918}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0463889-3735-5d23-be4b-2f0c37bed253/d0463889-3735-5d23-be4b-2f0c37bed253_image_4.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_5.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 203956}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0463889-3735-5d23-be4b-2f0c37bed253/d0463889-3735-5d23-be4b-2f0c37bed253_image_5.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_4.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 203914}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0463889-3735-5d23-be4b-2f0c37bed253/d0463889-3735-5d23-be4b-2f0c37bed253_image_6.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_11.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 186252}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0463889-3735-5d23-be4b-2f0c37bed253/d0463889-3735-5d23-be4b-2f0c37bed253_image_7.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_10.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 189605}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0463889-3735-5d23-be4b-2f0c37bed253/d0463889-3735-5d23-be4b-2f0c37bed253_image_8.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_9.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 197535}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0463889-3735-5d23-be4b-2f0c37bed253/d0463889-3735-5d23-be4b-2f0c37bed253_image_9.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_2.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 221045}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0463889-3735-5d23-be4b-2f0c37bed253/d0463889-3735-5d23-be4b-2f0c37bed253_image_10.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_5.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 161112}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0463889-3735-5d23-be4b-2f0c37bed253/d0463889-3735-5d23-be4b-2f0c37bed253_image_11.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_3.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 159330}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0463889-3735-5d23-be4b-2f0c37bed253/d0463889-3735-5d23-be4b-2f0c37bed253_image_12.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_4.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 187145}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0463889-3735-5d23-be4b-2f0c37bed253/d0463889-3735-5d23-be4b-2f0c37bed253_image_13.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3633295-3980370-13.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 268240}], 'current_year_diff': 1, 'age_in_months': 21, 'make_model': 'vauxhall astra', 'sanitized_make': 'vauxhall', 'odometer_in_km': 6126} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 21,
     'auction_title': '',
     'c_o_2_emission_value': 0,
     'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0463889-3735-5d23-be4b-2f0c37bed253/d0463889-3735-5d23-be4b-2f0c37bed253_expert_report_file_35349679-a6c2-494c-9744-d8f9f7949084.pdf',
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0003633295-01970529-004.pdf',
     'color': 'white',
     'currency': 'gbp',
     'current_year_diff': 1,
     'engine': '0.0l',
     'expiration_date': '2025-12-09t09:00:00z',
     'fuel_type': 'electric',
     'id': 'd0463889-3735-5d23-be4b-2f0c37bed253',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'fm73hge',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/vauxhall/astra?id=3633295',
     'listing': 'auction',
     'location': 'colchester',
     'make': 'vauxhall',
     'make_model': 'vauxhall astra',
     'model': 'astra',
     'odometer': 3807,
     'odometer_in_km': 6126,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 14,
     'photo_urls': ['http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_7.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_7.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_6.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_1.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_5.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_4.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_11.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_10.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_9.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_2.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_5.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_3.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_4.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/insp-0001-3633295-3980370-13.jpg'],
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0463889-3735-5d23-be4b-2f0c37bed253/d0463889-3735-5d23-be4b-2f0c37bed253_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 219920,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_7.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0463889-3735-5d23-be4b-2f0c37bed253/d0463889-3735-5d23-be4b-2f0c37bed253_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 219920,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_7.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0463889-3735-5d23-be4b-2f0c37bed253/d0463889-3735-5d23-be4b-2f0c37bed253_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 203854,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_6.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0463889-3735-5d23-be4b-2f0c37bed253/d0463889-3735-5d23-be4b-2f0c37bed253_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 125918,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_1.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0463889-3735-5d23-be4b-2f0c37bed253/d0463889-3735-5d23-be4b-2f0c37bed253_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 203956,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_5.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0463889-3735-5d23-be4b-2f0c37bed253/d0463889-3735-5d23-be4b-2f0c37bed253_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 203914,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_4.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0463889-3735-5d23-be4b-2f0c37bed253/d0463889-3735-5d23-be4b-2f0c37bed253_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 186252,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_11.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0463889-3735-5d23-be4b-2f0c37bed253/d0463889-3735-5d23-be4b-2f0c37bed253_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 189605,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_10.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0463889-3735-5d23-be4b-2f0c37bed253/d0463889-3735-5d23-be4b-2f0c37bed253_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 197535,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_9.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0463889-3735-5d23-be4b-2f0c37bed253/d0463889-3735-5d23-be4b-2f0c37bed253_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 221045,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_2.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0463889-3735-5d23-be4b-2f0c37bed253/d0463889-3735-5d23-be4b-2f0c37bed253_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 161112,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_5.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0463889-3735-5d23-be4b-2f0c37bed253/d0463889-3735-5d23-be4b-2f0c37bed253_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 159330,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_3.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0463889-3735-5d23-be4b-2f0c37bed253/d0463889-3735-5d23-be4b-2f0c37bed253_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 187145,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_4.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0463889-3735-5d23-be4b-2f0c37bed253/d0463889-3735-5d23-be4b-2f0c37bed253_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 268240,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3633295-3980370-13.jpg',
                 'Width': 1333}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2024-02-28',
     'sanitized_make': 'vauxhall',
     'seller_name': 'vauxhall motors limited',
     'title': 'vauxhall astra 115kw gs 54kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '115kw gs 54kwh 5dr auto',
     'year': 2024}
2025-12-04 10:07:45 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: d0463889-3735-5d23-be4b-2f0c37bed253 spider: manheim.gb
2025-12-04 10:07:45 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: d0463889-3735-5d23-be4b-2f0c37bed253 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 14, 'seller_name': 'vauxhall motors limited', 'price_includes_vat': False, 'title': 'vauxhall astra 115kw gs 54kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'vauxhall', 'model': 'astra', 'transmission': 'automatic', 'engine': '0.0l', 'fuel_type': 'electric', 'odometer': 3807, 'odometer_reading_unit': 'mi', 'registration_date': '2024-02-28', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/vauxhall/astra?id=3633295', 'location': 'colchester', 'origin_country_code': 'gb', 'trim': '115kw gs 54kwh 5dr auto', 'license_plate': 'fm73hge', 'year': 2024, 'listing': 'auction', 'c_o_2_emission_value': 0, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0003633295-01970529-004.pdf', 'expiration_date': '2025-12-09t09:00:00z', 'is_vat_deductible': True, 'is_vat_included': False, 'photo_urls': ['http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_7.jpg', 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_7.jpg', 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_6.jpg', 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_1.jpg', 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_5.jpg', 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_4.jpg', 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_11.jpg', 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_10.jpg', 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_9.jpg', 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_2.jpg', 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_5.jpg', 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_3.jpg', 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_4.jpg', 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3633295-3980370-13.jpg'], 'id': 'd0463889-3735-5d23-be4b-2f0c37bed253', 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0463889-3735-5d23-be4b-2f0c37bed253/d0463889-3735-5d23-be4b-2f0c37bed253_expert_report_file_35349679-a6c2-494c-9744-d8f9f7949084.pdf', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0463889-3735-5d23-be4b-2f0c37bed253/d0463889-3735-5d23-be4b-2f0c37bed253_image_1.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_7.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 219920}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0463889-3735-5d23-be4b-2f0c37bed253/d0463889-3735-5d23-be4b-2f0c37bed253_image_1.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_7.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 219920}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0463889-3735-5d23-be4b-2f0c37bed253/d0463889-3735-5d23-be4b-2f0c37bed253_image_2.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_6.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 203854}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0463889-3735-5d23-be4b-2f0c37bed253/d0463889-3735-5d23-be4b-2f0c37bed253_image_3.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_1.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 125918}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0463889-3735-5d23-be4b-2f0c37bed253/d0463889-3735-5d23-be4b-2f0c37bed253_image_4.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_5.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 203956}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0463889-3735-5d23-be4b-2f0c37bed253/d0463889-3735-5d23-be4b-2f0c37bed253_image_5.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_4.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 203914}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0463889-3735-5d23-be4b-2f0c37bed253/d0463889-3735-5d23-be4b-2f0c37bed253_image_6.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_11.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 186252}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0463889-3735-5d23-be4b-2f0c37bed253/d0463889-3735-5d23-be4b-2f0c37bed253_image_7.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_10.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 189605}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0463889-3735-5d23-be4b-2f0c37bed253/d0463889-3735-5d23-be4b-2f0c37bed253_image_8.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_9.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 197535}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0463889-3735-5d23-be4b-2f0c37bed253/d0463889-3735-5d23-be4b-2f0c37bed253_image_9.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_2.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 221045}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0463889-3735-5d23-be4b-2f0c37bed253/d0463889-3735-5d23-be4b-2f0c37bed253_image_10.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_5.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 161112}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0463889-3735-5d23-be4b-2f0c37bed253/d0463889-3735-5d23-be4b-2f0c37bed253_image_11.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_3.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 159330}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0463889-3735-5d23-be4b-2f0c37bed253/d0463889-3735-5d23-be4b-2f0c37bed253_image_12.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_4.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 187145}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0463889-3735-5d23-be4b-2f0c37bed253/d0463889-3735-5d23-be4b-2f0c37bed253_image_13.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3633295-3980370-13.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 268240}], 'current_year_diff': 1, 'age_in_months': 21, 'make_model': 'vauxhall astra', 'sanitized_make': 'vauxhall', 'odometer_in_km': 6126} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 21,
     'auction_title': '',
     'c_o_2_emission_value': 0,
     'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0463889-3735-5d23-be4b-2f0c37bed253/d0463889-3735-5d23-be4b-2f0c37bed253_expert_report_file_35349679-a6c2-494c-9744-d8f9f7949084.pdf',
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0003633295-01970529-004.pdf',
     'color': 'white',
     'currency': 'gbp',
     'current_year_diff': 1,
     'engine': '0.0l',
     'expiration_date': '2025-12-09t09:00:00z',
     'fuel_type': 'electric',
     'id': 'd0463889-3735-5d23-be4b-2f0c37bed253',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'fm73hge',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/vauxhall/astra?id=3633295',
     'listing': 'auction',
     'location': 'colchester',
     'make': 'vauxhall',
     'make_model': 'vauxhall astra',
     'model': 'astra',
     'odometer': 3807,
     'odometer_in_km': 6126,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 14,
     'photo_urls': ['http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_7.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_7.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_6.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_1.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_5.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_4.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_11.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_10.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_9.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_2.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_5.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_3.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_4.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/insp-0001-3633295-3980370-13.jpg'],
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0463889-3735-5d23-be4b-2f0c37bed253/d0463889-3735-5d23-be4b-2f0c37bed253_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 219920,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_7.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0463889-3735-5d23-be4b-2f0c37bed253/d0463889-3735-5d23-be4b-2f0c37bed253_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 219920,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_7.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0463889-3735-5d23-be4b-2f0c37bed253/d0463889-3735-5d23-be4b-2f0c37bed253_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 203854,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_6.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0463889-3735-5d23-be4b-2f0c37bed253/d0463889-3735-5d23-be4b-2f0c37bed253_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 125918,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_1.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0463889-3735-5d23-be4b-2f0c37bed253/d0463889-3735-5d23-be4b-2f0c37bed253_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 203956,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_5.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0463889-3735-5d23-be4b-2f0c37bed253/d0463889-3735-5d23-be4b-2f0c37bed253_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 203914,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_4.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0463889-3735-5d23-be4b-2f0c37bed253/d0463889-3735-5d23-be4b-2f0c37bed253_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 186252,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_11.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0463889-3735-5d23-be4b-2f0c37bed253/d0463889-3735-5d23-be4b-2f0c37bed253_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 189605,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_10.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0463889-3735-5d23-be4b-2f0c37bed253/d0463889-3735-5d23-be4b-2f0c37bed253_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 197535,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_9.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0463889-3735-5d23-be4b-2f0c37bed253/d0463889-3735-5d23-be4b-2f0c37bed253_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 221045,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_2.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0463889-3735-5d23-be4b-2f0c37bed253/d0463889-3735-5d23-be4b-2f0c37bed253_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 161112,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_5.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0463889-3735-5d23-be4b-2f0c37bed253/d0463889-3735-5d23-be4b-2f0c37bed253_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 159330,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_3.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0463889-3735-5d23-be4b-2f0c37bed253/d0463889-3735-5d23-be4b-2f0c37bed253_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 187145,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_4.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0463889-3735-5d23-be4b-2f0c37bed253/d0463889-3735-5d23-be4b-2f0c37bed253_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 268240,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3633295-3980370-13.jpg',
                 'Width': 1333}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2024-02-28',
     'sanitized_make': 'vauxhall',
     'seller_name': 'vauxhall motors limited',
     'title': 'vauxhall astra 115kw gs 54kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '115kw gs 54kwh 5dr auto',
     'year': 2024}
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0463889-3735-5d23-be4b-2f0c37bed253/d0463889-3735-5d23-be4b-2f0c37bed253_expert_report_file_35349679-a6c2-494c-9744-d8f9f7949084.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003633295-01970529-004.pdf',
 'color': 'White',
 'currency': 'GBP',
 'engine': '0.0L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Electric',
 'id': 'd0463889-3735-5d23-be4b-2f0c37bed253',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'FM73HGE',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VAUXHALL/ASTRA?id=3633295',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'VAUXHALL',
 'model': 'ASTRA',
 'odometer': 3807,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 14,
 'photo_urls': ['http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_7.jpg',
                'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_7.jpg',
                'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_6.jpg',
                'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_1.jpg',
                'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_5.jpg',
                'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_4.jpg',
                'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_11.jpg',
                'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_10.jpg',
                'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_9.jpg',
                'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_2.jpg',
                'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_5.jpg',
                'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_3.jpg',
                'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_4.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3633295-3980370-13.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0463889-3735-5d23-be4b-2f0c37bed253/d0463889-3735-5d23-be4b-2f0c37bed253_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 219920,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0463889-3735-5d23-be4b-2f0c37bed253/d0463889-3735-5d23-be4b-2f0c37bed253_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 219920,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0463889-3735-5d23-be4b-2f0c37bed253/d0463889-3735-5d23-be4b-2f0c37bed253_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 203854,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0463889-3735-5d23-be4b-2f0c37bed253/d0463889-3735-5d23-be4b-2f0c37bed253_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 125918,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0463889-3735-5d23-be4b-2f0c37bed253/d0463889-3735-5d23-be4b-2f0c37bed253_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 203956,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0463889-3735-5d23-be4b-2f0c37bed253/d0463889-3735-5d23-be4b-2f0c37bed253_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 203914,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0463889-3735-5d23-be4b-2f0c37bed253/d0463889-3735-5d23-be4b-2f0c37bed253_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 186252,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0463889-3735-5d23-be4b-2f0c37bed253/d0463889-3735-5d23-be4b-2f0c37bed253_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 189605,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0463889-3735-5d23-be4b-2f0c37bed253/d0463889-3735-5d23-be4b-2f0c37bed253_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 197535,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0463889-3735-5d23-be4b-2f0c37bed253/d0463889-3735-5d23-be4b-2f0c37bed253_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 221045,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0463889-3735-5d23-be4b-2f0c37bed253/d0463889-3735-5d23-be4b-2f0c37bed253_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 161112,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0463889-3735-5d23-be4b-2f0c37bed253/d0463889-3735-5d23-be4b-2f0c37bed253_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 159330,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0463889-3735-5d23-be4b-2f0c37bed253/d0463889-3735-5d23-be4b-2f0c37bed253_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 187145,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/34621b69-ed7d-422a-ad67-861f0dc98ca4_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0463889-3735-5d23-be4b-2f0c37bed253/d0463889-3735-5d23-be4b-2f0c37bed253_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 268240,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3633295-3980370-13.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-02-28',
 'seller_name': 'Vauxhall Motors Limited',
 'title': 'VAUXHALL ASTRA 115kW GS 54kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '115kW GS 54kWh 5dr Auto',
 'year': 2024}
2025-12-04 10:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273633295%27 HTTP/1.1" 200 None
2025-12-04 10:07:45 [manheim.gb] INFO: Saving data for 3633295: {'created_time': 1764842865.212368, 'last_price_update_time': 1764842865.212378, 'auction_closing_time': 1765270800.0}
2025-12-04 10:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3633295') HTTP/1.1" 204 0
2025-12-04 10:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/03307b7a-75ba-4386-ba32-131489a9974d_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003677202-01968493-004.pdf)
2025-12-04 10:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F03307b7a-75ba-4386-ba32-131489a9974d_9.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/03307b7a-75ba-4386-ba32-131489a9974d_9.jpg not downloaded yet
2025-12-04 10:07:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: acaf763c-39c3-5001-bfe8-4cff2ff87c31 with identifier: 3630205
2025-12-04 10:07:45 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item acaf763c-39c3-5001-bfe8-4cff2ff87c31
2025-12-04 10:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/03307b7a-75ba-4386-ba32-131489a9974d_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003677202-01968493-004.pdf)
2025-12-04 10:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/03307b7a-75ba-4386-ba32-131489a9974d_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003677202-01968493-004.pdf)
2025-12-04 10:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/03307b7a-75ba-4386-ba32-131489a9974d_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003677202-01968493-004.pdf)
2025-12-04 10:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3693298-3631035-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003693298-1001400926-002.pdf)
2025-12-04 10:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/03ec0254-4d90-4b3a-bada-4e8408ad022f_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003693298-1001400926-002.pdf)
2025-12-04 10:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/03307b7a-75ba-4386-ba32-131489a9974d_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003677202-01968493-004.pdf)
2025-12-04 10:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F03307b7a-75ba-4386-ba32-131489a9974d_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/03307b7a-75ba-4386-ba32-131489a9974d_ext_2.jpg not downloaded yet
2025-12-04 10:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/03ec0254-4d90-4b3a-bada-4e8408ad022f_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003693298-1001400926-002.pdf)
2025-12-04 10:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F03307b7a-75ba-4386-ba32-131489a9974d_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/03307b7a-75ba-4386-ba32-131489a9974d_ext_5.jpg not downloaded yet
2025-12-04 10:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F03307b7a-75ba-4386-ba32-131489a9974d_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/03307b7a-75ba-4386-ba32-131489a9974d_ext_3.jpg not downloaded yet
2025-12-04 10:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003634767-01984079-005.pdf> (referer: None)
2025-12-04 10:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F03307b7a-75ba-4386-ba32-131489a9974d_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/03307b7a-75ba-4386-ba32-131489a9974d_ext_4.jpg not downloaded yet
2025-12-04 10:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3677202-3976403-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3677202-3976403-13.jpg not downloaded yet
2025-12-04 10:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3677202-3976403-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3677202-3976403-1000.jpg not downloaded yet
2025-12-04 10:07:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf69690>
2025-12-04 10:07:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:07:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2fbbc445-b915-58e2-ba7a-9c92dc3e12e7/2fbbc445-b915-58e2-ba7a-9c92dc3e12e7_image_3.jpg HTTP/1.1" 201 0
2025-12-04 10:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F03307b7a-75ba-4386-ba32-131489a9974d_ext_1.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/03307b7a-75ba-4386-ba32-131489a9974d_ext_1.jpg saved to cache
2025-12-04 10:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2fbbc445-b915-58e2-ba7a-9c92dc3e12e7
2025-12-04 10:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3677202-3976403-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3677202-3976403-1001.jpg not downloaded yet
2025-12-04 10:07:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd01c1d0>
2025-12-04 10:07:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:07:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2fbbc445-b915-58e2-ba7a-9c92dc3e12e7/2fbbc445-b915-58e2-ba7a-9c92dc3e12e7_image_1.jpg HTTP/1.1" 201 0
2025-12-04 10:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F03307b7a-75ba-4386-ba32-131489a9974d_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/03307b7a-75ba-4386-ba32-131489a9974d_ext_7.jpg saved to cache
2025-12-04 10:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2fbbc445-b915-58e2-ba7a-9c92dc3e12e7
2025-12-04 10:07:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc59b950>
2025-12-04 10:07:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:07:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2fbbc445-b915-58e2-ba7a-9c92dc3e12e7/2fbbc445-b915-58e2-ba7a-9c92dc3e12e7_image_4.jpg HTTP/1.1" 201 0
2025-12-04 10:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F03307b7a-75ba-4386-ba32-131489a9974d_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/03307b7a-75ba-4386-ba32-131489a9974d_5.jpg saved to cache
2025-12-04 10:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2fbbc445-b915-58e2-ba7a-9c92dc3e12e7
2025-12-04 10:07:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc7c9cd0>
2025-12-04 10:07:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:07:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2fbbc445-b915-58e2-ba7a-9c92dc3e12e7/2fbbc445-b915-58e2-ba7a-9c92dc3e12e7_image_0.jpg HTTP/1.1" 201 0
2025-12-04 10:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F03307b7a-75ba-4386-ba32-131489a9974d_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/03307b7a-75ba-4386-ba32-131489a9974d_ext_7.jpg saved to cache
2025-12-04 10:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2fbbc445-b915-58e2-ba7a-9c92dc3e12e7
2025-12-04 10:07:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccec7e10>
2025-12-04 10:07:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:07:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df58e7f8-61e7-56dd-9423-3b35c4acd52f/df58e7f8-61e7-56dd-9423-3b35c4acd52f_image_15.jpg HTTP/1.1" 201 0
2025-12-04 10:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3693298-3631035-1001.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3693298-3631035-1001.jpg saved to cache
2025-12-04 10:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item df58e7f8-61e7-56dd-9423-3b35c4acd52f
2025-12-04 10:07:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6cf7d0>
2025-12-04 10:07:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:07:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df58e7f8-61e7-56dd-9423-3b35c4acd52f/df58e7f8-61e7-56dd-9423-3b35c4acd52f_image_11.jpg HTTP/1.1" 201 0
2025-12-04 10:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F03ec0254-4d90-4b3a-bada-4e8408ad022f_ext_3.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/03ec0254-4d90-4b3a-bada-4e8408ad022f_ext_3.jpg saved to cache
2025-12-04 10:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item df58e7f8-61e7-56dd-9423-3b35c4acd52f
2025-12-04 10:07:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6fbe10>
2025-12-04 10:07:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:07:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2fbbc445-b915-58e2-ba7a-9c92dc3e12e7/2fbbc445-b915-58e2-ba7a-9c92dc3e12e7_image_2.jpg HTTP/1.1" 201 0
2025-12-04 10:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F03307b7a-75ba-4386-ba32-131489a9974d_ext_6.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/03307b7a-75ba-4386-ba32-131489a9974d_ext_6.jpg saved to cache
2025-12-04 10:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2fbbc445-b915-58e2-ba7a-9c92dc3e12e7
2025-12-04 10:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3677202-3976403-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3677202-3976403-1002.jpg not downloaded yet
2025-12-04 10:07:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/03307b7a-75ba-4386-ba32-131489a9974d_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003677202-01968493-004.pdf)
2025-12-04 10:07:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/03307b7a-75ba-4386-ba32-131489a9974d_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003677202-01968493-004.pdf)
2025-12-04 10:07:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5d10084d0>
2025-12-04 10:07:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:07:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df58e7f8-61e7-56dd-9423-3b35c4acd52f/df58e7f8-61e7-56dd-9423-3b35c4acd52f_image_10.jpg HTTP/1.1" 201 0
2025-12-04 10:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F03ec0254-4d90-4b3a-bada-4e8408ad022f_ext_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/03ec0254-4d90-4b3a-bada-4e8408ad022f_ext_5.jpg saved to cache
2025-12-04 10:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item df58e7f8-61e7-56dd-9423-3b35c4acd52f
2025-12-04 10:07:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccde93d0>
2025-12-04 10:07:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 10:07:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9945aa33-abc6-54b3-9bbd-4b873e292c5f/9945aa33-abc6-54b3-9bbd-4b873e292c5f_expert_report_file_5483397c-7d98-4843-9d98-0948e38dab3a.pdf HTTP/1.1" 201 0
2025-12-04 10:07:48 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 9945aa33-abc6-54b3-9bbd-4b873e292c5f
2025-12-04 10:07:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9945aa33-abc6-54b3-9bbd-4b873e292c5f, skipping ID generation
2025-12-04 10:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 9945aa33-abc6-54b3-9bbd-4b873e292c5f
2025-12-04 10:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F346086e5-1ebf-47cd-b256-bc11c2cbcdde_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/346086e5-1ebf-47cd-b256-bc11c2cbcdde_ext_7.jpg not downloaded yet
2025-12-04 10:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3677202-3976403-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3677202-3976403-1003.jpg not downloaded yet
2025-12-04 10:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003684881-01983788-004.pdf> (referer: None)
2025-12-04 10:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/03ec0254-4d90-4b3a-bada-4e8408ad022f_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003693298-1001400926-002.pdf)
2025-12-04 10:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F346086e5-1ebf-47cd-b256-bc11c2cbcdde_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/346086e5-1ebf-47cd-b256-bc11c2cbcdde_ext_7.jpg not downloaded yet
2025-12-04 10:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3677202-3976403-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3677202-3976403-1004.jpg not downloaded yet
2025-12-04 10:07:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc7f76d0>
2025-12-04 10:07:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:07:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2fbbc445-b915-58e2-ba7a-9c92dc3e12e7/2fbbc445-b915-58e2-ba7a-9c92dc3e12e7_image_7.jpg HTTP/1.1" 201 0
2025-12-04 10:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F03307b7a-75ba-4386-ba32-131489a9974d_10.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/03307b7a-75ba-4386-ba32-131489a9974d_10.jpg saved to cache
2025-12-04 10:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2fbbc445-b915-58e2-ba7a-9c92dc3e12e7
2025-12-04 10:07:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd062910>
2025-12-04 10:07:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:07:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2fbbc445-b915-58e2-ba7a-9c92dc3e12e7/2fbbc445-b915-58e2-ba7a-9c92dc3e12e7_image_5.jpg HTTP/1.1" 201 0
2025-12-04 10:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F03307b7a-75ba-4386-ba32-131489a9974d_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/03307b7a-75ba-4386-ba32-131489a9974d_4.jpg saved to cache
2025-12-04 10:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2fbbc445-b915-58e2-ba7a-9c92dc3e12e7
2025-12-04 10:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F346086e5-1ebf-47cd-b256-bc11c2cbcdde_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/346086e5-1ebf-47cd-b256-bc11c2cbcdde_ext_6.jpg not downloaded yet
2025-12-04 10:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3677202-3976403-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3677202-3976403-1005.jpg not downloaded yet
2025-12-04 10:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F346086e5-1ebf-47cd-b256-bc11c2cbcdde_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/346086e5-1ebf-47cd-b256-bc11c2cbcdde_ext_1.jpg not downloaded yet
2025-12-04 10:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F346086e5-1ebf-47cd-b256-bc11c2cbcdde_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/346086e5-1ebf-47cd-b256-bc11c2cbcdde_5.jpg not downloaded yet
2025-12-04 10:07:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5af8d0>
2025-12-04 10:07:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:07:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9284d511-d309-5f25-914b-ed90b8239ecf/9284d511-d309-5f25-914b-ed90b8239ecf_expert_report_file_f3f457c4-9142-4e3a-8fcb-61688fe9b4de.pdf HTTP/1.1" 201 0
2025-12-04 10:07:49 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 9284d511-d309-5f25-914b-ed90b8239ecf
2025-12-04 10:07:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9284d511-d309-5f25-914b-ed90b8239ecf, skipping ID generation
2025-12-04 10:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 19 photos for item 9284d511-d309-5f25-914b-ed90b8239ecf
2025-12-04 10:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3684881-9999999-330143646-004.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3684881-9999999-330143646-004.jpg not downloaded yet
2025-12-04 10:07:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc68e350>
2025-12-04 10:07:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:07:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df58e7f8-61e7-56dd-9423-3b35c4acd52f/df58e7f8-61e7-56dd-9423-3b35c4acd52f_image_9.jpg HTTP/1.1" 201 0
2025-12-04 10:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F03ec0254-4d90-4b3a-bada-4e8408ad022f_ext_2.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/03ec0254-4d90-4b3a-bada-4e8408ad022f_ext_2.jpg saved to cache
2025-12-04 10:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item df58e7f8-61e7-56dd-9423-3b35c4acd52f
2025-12-04 10:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F346086e5-1ebf-47cd-b256-bc11c2cbcdde_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/346086e5-1ebf-47cd-b256-bc11c2cbcdde_4.jpg not downloaded yet
2025-12-04 10:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3684881-9999999-330143646-008.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3684881-9999999-330143646-008.jpg not downloaded yet
2025-12-04 10:07:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/FORD/KA?id=363011&returnUrl=%2Fsearch%3FPage%3D4%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%23363011&indx=317> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 10:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F346086e5-1ebf-47cd-b256-bc11c2cbcdde_11.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/346086e5-1ebf-47cd-b256-bc11c2cbcdde_11.jpg not downloaded yet
2025-12-04 10:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3684881-9999999-330143646-001.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3684881-9999999-330143646-001.jpg not downloaded yet
2025-12-04 10:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F346086e5-1ebf-47cd-b256-bc11c2cbcdde_10.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/346086e5-1ebf-47cd-b256-bc11c2cbcdde_10.jpg not downloaded yet
2025-12-04 10:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3684881-9999999-330143646-002.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3684881-9999999-330143646-002.jpg not downloaded yet
2025-12-04 10:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F346086e5-1ebf-47cd-b256-bc11c2cbcdde_9.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/346086e5-1ebf-47cd-b256-bc11c2cbcdde_9.jpg not downloaded yet
2025-12-04 10:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3684881-9999999-330143646-003.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3684881-9999999-330143646-003.jpg not downloaded yet
2025-12-04 10:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F346086e5-1ebf-47cd-b256-bc11c2cbcdde_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/346086e5-1ebf-47cd-b256-bc11c2cbcdde_ext_2.jpg not downloaded yet
2025-12-04 10:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3684881-9999999-330143646-005.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3684881-9999999-330143646-005.jpg not downloaded yet
2025-12-04 10:07:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ba9d830-17c9-5bf8-86a6-04450b3e9296 with identifier: 363011
2025-12-04 10:07:50 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 1ba9d830-17c9-5bf8-86a6-04450b3e9296
2025-12-04 10:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F346086e5-1ebf-47cd-b256-bc11c2cbcdde_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/346086e5-1ebf-47cd-b256-bc11c2cbcdde_ext_5.jpg not downloaded yet
2025-12-04 10:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3684881-9999999-330143646-006.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3684881-9999999-330143646-006.jpg not downloaded yet
2025-12-04 10:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F346086e5-1ebf-47cd-b256-bc11c2cbcdde_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/346086e5-1ebf-47cd-b256-bc11c2cbcdde_ext_3.jpg not downloaded yet
2025-12-04 10:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3684881-9999999-330143646-007.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3684881-9999999-330143646-007.jpg not downloaded yet
2025-12-04 10:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F346086e5-1ebf-47cd-b256-bc11c2cbcdde_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/346086e5-1ebf-47cd-b256-bc11c2cbcdde_ext_4.jpg not downloaded yet
2025-12-04 10:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3684881-9999999-330143646-009.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3684881-9999999-330143646-009.jpg not downloaded yet
2025-12-04 10:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3634767-3998393-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3634767-3998393-13.jpg not downloaded yet
2025-12-04 10:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3684881-9999999-330143646-010.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3684881-9999999-330143646-010.jpg not downloaded yet
2025-12-04 10:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/346086e5-1ebf-47cd-b256-bc11c2cbcdde_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003634767-01984079-005.pdf)
2025-12-04 10:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3634767-3998393-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3634767-3998393-1000.jpg not downloaded yet
2025-12-04 10:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3684881-9999999-330143646-011.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3684881-9999999-330143646-011.jpg not downloaded yet
2025-12-04 10:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/346086e5-1ebf-47cd-b256-bc11c2cbcdde_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003634767-01984079-005.pdf)
2025-12-04 10:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3634767-3998393-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3634767-3998393-1001.jpg not downloaded yet
2025-12-04 10:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3684881-9999999-330143646-012.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3684881-9999999-330143646-012.jpg not downloaded yet
2025-12-04 10:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3677202-3976403-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003677202-01968493-004.pdf)
2025-12-04 10:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3677202-3976403-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003677202-01968493-004.pdf)
2025-12-04 10:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3684881-9999999-330143646-004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003684881-01983788-004.pdf)
2025-12-04 10:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/346086e5-1ebf-47cd-b256-bc11c2cbcdde_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003634767-01984079-005.pdf)
2025-12-04 10:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3634767-3998393-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3634767-3998393-1002.jpg not downloaded yet
2025-12-04 10:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3684881-3998776-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3684881-3998776-13.jpg not downloaded yet
2025-12-04 10:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3634767-3998393-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3634767-3998393-1003.jpg not downloaded yet
2025-12-04 10:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3684881-3998776-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3684881-3998776-1000.jpg not downloaded yet
2025-12-04 10:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/346086e5-1ebf-47cd-b256-bc11c2cbcdde_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003634767-01984079-005.pdf)
2025-12-04 10:07:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccc5cfd0>
2025-12-04 10:07:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:07:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9945aa33-abc6-54b3-9bbd-4b873e292c5f/9945aa33-abc6-54b3-9bbd-4b873e292c5f_image_4.jpg HTTP/1.1" 201 0
2025-12-04 10:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F346086e5-1ebf-47cd-b256-bc11c2cbcdde_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/346086e5-1ebf-47cd-b256-bc11c2cbcdde_5.jpg saved to cache
2025-12-04 10:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9945aa33-abc6-54b3-9bbd-4b873e292c5f
2025-12-04 10:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3634767-3998393-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3634767-3998393-1004.jpg not downloaded yet
2025-12-04 10:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3684881-3998776-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3684881-3998776-1001.jpg not downloaded yet
2025-12-04 10:07:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd0a0a50>
2025-12-04 10:07:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:07:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9945aa33-abc6-54b3-9bbd-4b873e292c5f/9945aa33-abc6-54b3-9bbd-4b873e292c5f_image_2.jpg HTTP/1.1" 201 0
2025-12-04 10:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F346086e5-1ebf-47cd-b256-bc11c2cbcdde_ext_6.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/346086e5-1ebf-47cd-b256-bc11c2cbcdde_ext_6.jpg saved to cache
2025-12-04 10:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9945aa33-abc6-54b3-9bbd-4b873e292c5f
2025-12-04 10:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3634767-3998393-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3634767-3998393-1005.jpg not downloaded yet
2025-12-04 10:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3684881-3998776-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3684881-3998776-1002.jpg not downloaded yet
2025-12-04 10:07:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc726fd0>
2025-12-04 10:07:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:07:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2fbbc445-b915-58e2-ba7a-9c92dc3e12e7/2fbbc445-b915-58e2-ba7a-9c92dc3e12e7_image_19.jpg HTTP/1.1" 201 0
2025-12-04 10:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3677202-3976403-1005.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3677202-3976403-1005.jpg saved to cache
2025-12-04 10:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 2fbbc445-b915-58e2-ba7a-9c92dc3e12e7
2025-12-04 10:07:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccefea90>
2025-12-04 10:07:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:07:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2fbbc445-b915-58e2-ba7a-9c92dc3e12e7/2fbbc445-b915-58e2-ba7a-9c92dc3e12e7_image_17.jpg HTTP/1.1" 201 0
2025-12-04 10:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3677202-3976403-1003.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3677202-3976403-1003.jpg saved to cache
2025-12-04 10:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 2fbbc445-b915-58e2-ba7a-9c92dc3e12e7
2025-12-04 10:07:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc699f50>
2025-12-04 10:07:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:07:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9284d511-d309-5f25-914b-ed90b8239ecf/9284d511-d309-5f25-914b-ed90b8239ecf_image_0.jpg HTTP/1.1" 201 0
2025-12-04 10:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3684881-9999999-330143646-004.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3684881-9999999-330143646-004.jpg saved to cache
2025-12-04 10:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9284d511-d309-5f25-914b-ed90b8239ecf
2025-12-04 10:07:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc603f50>
2025-12-04 10:07:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:07:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9945aa33-abc6-54b3-9bbd-4b873e292c5f/9945aa33-abc6-54b3-9bbd-4b873e292c5f_image_3.jpg HTTP/1.1" 201 0
2025-12-04 10:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F346086e5-1ebf-47cd-b256-bc11c2cbcdde_ext_1.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/346086e5-1ebf-47cd-b256-bc11c2cbcdde_ext_1.jpg saved to cache
2025-12-04 10:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9945aa33-abc6-54b3-9bbd-4b873e292c5f
2025-12-04 10:07:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd64550>
2025-12-04 10:07:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:07:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9945aa33-abc6-54b3-9bbd-4b873e292c5f/9945aa33-abc6-54b3-9bbd-4b873e292c5f_image_1.jpg HTTP/1.1" 201 0
2025-12-04 10:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F346086e5-1ebf-47cd-b256-bc11c2cbcdde_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/346086e5-1ebf-47cd-b256-bc11c2cbcdde_ext_7.jpg saved to cache
2025-12-04 10:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9945aa33-abc6-54b3-9bbd-4b873e292c5f
2025-12-04 10:07:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3677202-3976403-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003677202-01968493-004.pdf)
2025-12-04 10:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3684881-3998776-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3684881-3998776-1003.jpg not downloaded yet
2025-12-04 10:07:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/MG/MG5?id=3622898&returnUrl=%2Fsearch%3FPage%3D4%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233622898&indx=316> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 10:07:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3677202-3976403-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003677202-01968493-004.pdf)
2025-12-04 10:07:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/346086e5-1ebf-47cd-b256-bc11c2cbcdde_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003634767-01984079-005.pdf)
2025-12-04 10:07:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3677202-3976403-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003677202-01968493-004.pdf)
2025-12-04 10:07:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3677202-3976403-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003677202-01968493-004.pdf)
2025-12-04 10:07:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3684881-9999999-330143646-010.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003684881-01983788-004.pdf)
2025-12-04 10:07:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3684881-9999999-330143646-008.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003684881-01983788-004.pdf)
2025-12-04 10:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3684881-3998776-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3684881-3998776-1004.jpg not downloaded yet
2025-12-04 10:07:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3684881-9999999-330143646-011.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003684881-01983788-004.pdf)
2025-12-04 10:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3684881-3998776-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3684881-3998776-1005.jpg not downloaded yet
2025-12-04 10:07:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6d3f90>
2025-12-04 10:07:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:07:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2fbbc445-b915-58e2-ba7a-9c92dc3e12e7/2fbbc445-b915-58e2-ba7a-9c92dc3e12e7_image_18.jpg HTTP/1.1" 201 0
2025-12-04 10:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3677202-3976403-1004.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3677202-3976403-1004.jpg saved to cache
2025-12-04 10:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 2fbbc445-b915-58e2-ba7a-9c92dc3e12e7
2025-12-04 10:07:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3684881-3998776-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003684881-01983788-004.pdf)
2025-12-04 10:07:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26ea40f5-de22-5022-b6fb-7b145e170b88 with identifier: 3622898
2025-12-04 10:07:53 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 26ea40f5-de22-5022-b6fb-7b145e170b88
2025-12-04 10:07:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccc8eb90>
2025-12-04 10:07:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:07:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2fbbc445-b915-58e2-ba7a-9c92dc3e12e7/2fbbc445-b915-58e2-ba7a-9c92dc3e12e7_image_14.jpg HTTP/1.1" 201 0
2025-12-04 10:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3677202-3976403-1000.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3677202-3976403-1000.jpg saved to cache
2025-12-04 10:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 2fbbc445-b915-58e2-ba7a-9c92dc3e12e7
2025-12-04 10:07:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd12910>
2025-12-04 10:07:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:07:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9945aa33-abc6-54b3-9bbd-4b873e292c5f/9945aa33-abc6-54b3-9bbd-4b873e292c5f_image_0.jpg HTTP/1.1" 201 0
2025-12-04 10:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F346086e5-1ebf-47cd-b256-bc11c2cbcdde_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/346086e5-1ebf-47cd-b256-bc11c2cbcdde_ext_7.jpg saved to cache
2025-12-04 10:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9945aa33-abc6-54b3-9bbd-4b873e292c5f
2025-12-04 10:07:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ce39b610>
2025-12-04 10:07:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:07:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2fbbc445-b915-58e2-ba7a-9c92dc3e12e7/2fbbc445-b915-58e2-ba7a-9c92dc3e12e7_image_15.jpg HTTP/1.1" 201 0
2025-12-04 10:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3677202-3976403-1001.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3677202-3976403-1001.jpg saved to cache
2025-12-04 10:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 2fbbc445-b915-58e2-ba7a-9c92dc3e12e7
2025-12-04 10:07:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd0c0390>
2025-12-04 10:07:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:07:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2fbbc445-b915-58e2-ba7a-9c92dc3e12e7/2fbbc445-b915-58e2-ba7a-9c92dc3e12e7_image_16.jpg HTTP/1.1" 201 0
2025-12-04 10:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3677202-3976403-1002.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3677202-3976403-1002.jpg saved to cache
2025-12-04 10:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 2fbbc445-b915-58e2-ba7a-9c92dc3e12e7
2025-12-04 10:07:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd11690>
2025-12-04 10:07:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:07:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9284d511-d309-5f25-914b-ed90b8239ecf/9284d511-d309-5f25-914b-ed90b8239ecf_image_9.jpg HTTP/1.1" 201 0
2025-12-04 10:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3684881-9999999-330143646-010.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3684881-9999999-330143646-010.jpg saved to cache
2025-12-04 10:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9284d511-d309-5f25-914b-ed90b8239ecf
2025-12-04 10:07:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd11d90>
2025-12-04 10:07:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:07:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9284d511-d309-5f25-914b-ed90b8239ecf/9284d511-d309-5f25-914b-ed90b8239ecf_image_1.jpg HTTP/1.1" 201 0
2025-12-04 10:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3684881-9999999-330143646-008.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3684881-9999999-330143646-008.jpg saved to cache
2025-12-04 10:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9284d511-d309-5f25-914b-ed90b8239ecf
2025-12-04 10:07:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd0eab10>
2025-12-04 10:07:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:07:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9284d511-d309-5f25-914b-ed90b8239ecf/9284d511-d309-5f25-914b-ed90b8239ecf_image_10.jpg HTTP/1.1" 201 0
2025-12-04 10:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3684881-9999999-330143646-011.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3684881-9999999-330143646-011.jpg saved to cache
2025-12-04 10:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 9284d511-d309-5f25-914b-ed90b8239ecf
2025-12-04 10:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3634767-3998393-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003634767-01984079-005.pdf)
2025-12-04 10:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3634767-3998393-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003634767-01984079-005.pdf)
2025-12-04 10:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3684881-3998776-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003684881-01983788-004.pdf)
2025-12-04 10:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/POLO?id=3655657&returnUrl=%2Fsearch%3FPage%3D4%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233655657&indx=324> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 10:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3634767-3998393-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003634767-01984079-005.pdf)
2025-12-04 10:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3684881-9999999-330143646-012.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003684881-01983788-004.pdf)
2025-12-04 10:07:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6cda10>
2025-12-04 10:07:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:07:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9284d511-d309-5f25-914b-ed90b8239ecf/9284d511-d309-5f25-914b-ed90b8239ecf_image_15.jpg HTTP/1.1" 201 0
2025-12-04 10:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3684881-3998776-1002.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3684881-3998776-1002.jpg saved to cache
2025-12-04 10:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 9284d511-d309-5f25-914b-ed90b8239ecf
2025-12-04 10:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3684881-3998776-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003684881-01983788-004.pdf)
2025-12-04 10:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/FORD/FIESTA?id=3613252&returnUrl=%2Fsearch%3FPage%3D4%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233613252&indx=311> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 10:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3634767-3998393-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003634767-01984079-005.pdf)
2025-12-04 10:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3634767-3998393-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003634767-01984079-005.pdf)
2025-12-04 10:07:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd0a2ad0>
2025-12-04 10:07:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:07:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9945aa33-abc6-54b3-9bbd-4b873e292c5f/9945aa33-abc6-54b3-9bbd-4b873e292c5f_image_14.jpg HTTP/1.1" 201 0
2025-12-04 10:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3634767-3998393-1000.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3634767-3998393-1000.jpg saved to cache
2025-12-04 10:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 9945aa33-abc6-54b3-9bbd-4b873e292c5f
2025-12-04 10:07:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccc690d0>
2025-12-04 10:07:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 10:07:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9945aa33-abc6-54b3-9bbd-4b873e292c5f/9945aa33-abc6-54b3-9bbd-4b873e292c5f_image_13.jpg HTTP/1.1" 201 0
2025-12-04 10:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3634767-3998393-13.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3634767-3998393-13.jpg saved to cache
2025-12-04 10:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 9945aa33-abc6-54b3-9bbd-4b873e292c5f
2025-12-04 10:07:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ce359dd0>
2025-12-04 10:07:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:07:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9284d511-d309-5f25-914b-ed90b8239ecf/9284d511-d309-5f25-914b-ed90b8239ecf_image_12.jpg HTTP/1.1" 201 0
2025-12-04 10:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3684881-3998776-13.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3684881-3998776-13.jpg saved to cache
2025-12-04 10:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 9284d511-d309-5f25-914b-ed90b8239ecf
2025-12-04 10:07:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5edeafc5-e046-59de-ab0b-202840dea4e9 with identifier: 3655657
2025-12-04 10:07:56 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 5edeafc5-e046-59de-ab0b-202840dea4e9
2025-12-04 10:07:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd1d0d0>
2025-12-04 10:07:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:07:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9945aa33-abc6-54b3-9bbd-4b873e292c5f/9945aa33-abc6-54b3-9bbd-4b873e292c5f_image_15.jpg HTTP/1.1" 201 0
2025-12-04 10:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3634767-3998393-1001.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3634767-3998393-1001.jpg saved to cache
2025-12-04 10:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 9945aa33-abc6-54b3-9bbd-4b873e292c5f
2025-12-04 10:07:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd0a0290>
2025-12-04 10:07:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:07:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9284d511-d309-5f25-914b-ed90b8239ecf/9284d511-d309-5f25-914b-ed90b8239ecf_image_11.jpg HTTP/1.1" 201 0
2025-12-04 10:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3684881-9999999-330143646-012.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3684881-9999999-330143646-012.jpg saved to cache
2025-12-04 10:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 9284d511-d309-5f25-914b-ed90b8239ecf
2025-12-04 10:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3684881-3998776-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003684881-01983788-004.pdf)
2025-12-04 10:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3684881-3998776-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003684881-01983788-004.pdf)
2025-12-04 10:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3634767-3998393-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003634767-01984079-005.pdf)
2025-12-04 10:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3684881-9999999-330143646-009.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003684881-01983788-004.pdf)
2025-12-04 10:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3634767-3998393-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003634767-01984079-005.pdf)
2025-12-04 10:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/346086e5-1ebf-47cd-b256-bc11c2cbcdde_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003634767-01984079-005.pdf)
2025-12-04 10:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3684881-3998776-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003684881-01983788-004.pdf)
2025-12-04 10:07:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cccaa250>
2025-12-04 10:07:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:07:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9284d511-d309-5f25-914b-ed90b8239ecf/9284d511-d309-5f25-914b-ed90b8239ecf_image_16.jpg HTTP/1.1" 201 0
2025-12-04 10:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3684881-3998776-1003.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3684881-3998776-1003.jpg saved to cache
2025-12-04 10:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 9284d511-d309-5f25-914b-ed90b8239ecf
2025-12-04 10:07:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8be1cec-e312-503e-a3eb-d5705c7c2660 with identifier: 3613252
2025-12-04 10:07:57 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item d8be1cec-e312-503e-a3eb-d5705c7c2660
2025-12-04 10:07:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc597a10>
2025-12-04 10:07:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:07:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9945aa33-abc6-54b3-9bbd-4b873e292c5f/9945aa33-abc6-54b3-9bbd-4b873e292c5f_image_19.jpg HTTP/1.1" 201 0
2025-12-04 10:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3634767-3998393-1005.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3634767-3998393-1005.jpg saved to cache
2025-12-04 10:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 9945aa33-abc6-54b3-9bbd-4b873e292c5f
2025-12-04 10:07:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd004b90>
2025-12-04 10:07:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:07:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9945aa33-abc6-54b3-9bbd-4b873e292c5f/9945aa33-abc6-54b3-9bbd-4b873e292c5f_image_18.jpg HTTP/1.1" 201 0
2025-12-04 10:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3634767-3998393-1004.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3634767-3998393-1004.jpg saved to cache
2025-12-04 10:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 9945aa33-abc6-54b3-9bbd-4b873e292c5f
2025-12-04 10:07:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3684881-3998776-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003684881-01983788-004.pdf)
2025-12-04 10:07:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/346086e5-1ebf-47cd-b256-bc11c2cbcdde_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003634767-01984079-005.pdf)
2025-12-04 10:07:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3684881-9999999-330143646-006.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003684881-01983788-004.pdf)
2025-12-04 10:07:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/346086e5-1ebf-47cd-b256-bc11c2cbcdde_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003634767-01984079-005.pdf)
2025-12-04 10:07:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd497d0>
2025-12-04 10:07:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:07:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9284d511-d309-5f25-914b-ed90b8239ecf/9284d511-d309-5f25-914b-ed90b8239ecf_image_14.jpg HTTP/1.1" 201 0
2025-12-04 10:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3684881-3998776-1001.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3684881-3998776-1001.jpg saved to cache
2025-12-04 10:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 9284d511-d309-5f25-914b-ed90b8239ecf
2025-12-04 10:07:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccec5b50>
2025-12-04 10:07:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:07:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9284d511-d309-5f25-914b-ed90b8239ecf/9284d511-d309-5f25-914b-ed90b8239ecf_image_13.jpg HTTP/1.1" 201 0
2025-12-04 10:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3684881-3998776-1000.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3684881-3998776-1000.jpg saved to cache
2025-12-04 10:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 9284d511-d309-5f25-914b-ed90b8239ecf
2025-12-04 10:07:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5f45d0>
2025-12-04 10:07:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:07:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9945aa33-abc6-54b3-9bbd-4b873e292c5f/9945aa33-abc6-54b3-9bbd-4b873e292c5f_image_17.jpg HTTP/1.1" 201 0
2025-12-04 10:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3634767-3998393-1003.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3634767-3998393-1003.jpg saved to cache
2025-12-04 10:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 9945aa33-abc6-54b3-9bbd-4b873e292c5f
2025-12-04 10:07:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccc5e210>
2025-12-04 10:07:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:07:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:07:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9284d511-d309-5f25-914b-ed90b8239ecf/9284d511-d309-5f25-914b-ed90b8239ecf_image_8.jpg HTTP/1.1" 201 0
2025-12-04 10:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3684881-9999999-330143646-009.jpg') HTTP/1.1" 204 0
2025-12-04 10:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3684881-9999999-330143646-009.jpg saved to cache
2025-12-04 10:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9284d511-d309-5f25-914b-ed90b8239ecf
2025-12-04 10:07:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:07:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:07:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:07:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd83310>
2025-12-04 10:07:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:07:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:07:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:07:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9945aa33-abc6-54b3-9bbd-4b873e292c5f/9945aa33-abc6-54b3-9bbd-4b873e292c5f_image_16.jpg HTTP/1.1" 201 0
2025-12-04 10:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3634767-3998393-1002.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3634767-3998393-1002.jpg saved to cache
2025-12-04 10:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 9945aa33-abc6-54b3-9bbd-4b873e292c5f
2025-12-04 10:08:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5a9910>
2025-12-04 10:08:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:08:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9945aa33-abc6-54b3-9bbd-4b873e292c5f/9945aa33-abc6-54b3-9bbd-4b873e292c5f_image_12.jpg HTTP/1.1" 201 0
2025-12-04 10:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F346086e5-1ebf-47cd-b256-bc11c2cbcdde_ext_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/346086e5-1ebf-47cd-b256-bc11c2cbcdde_ext_4.jpg saved to cache
2025-12-04 10:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 9945aa33-abc6-54b3-9bbd-4b873e292c5f
2025-12-04 10:08:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce09450>
2025-12-04 10:08:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:08:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9284d511-d309-5f25-914b-ed90b8239ecf/9284d511-d309-5f25-914b-ed90b8239ecf_image_18.jpg HTTP/1.1" 201 0
2025-12-04 10:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3684881-3998776-1005.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3684881-3998776-1005.jpg saved to cache
2025-12-04 10:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 9284d511-d309-5f25-914b-ed90b8239ecf
2025-12-04 10:08:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3684881-9999999-330143646-007.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003684881-01983788-004.pdf)
2025-12-04 10:08:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3684881-9999999-330143646-005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003684881-01983788-004.pdf)
2025-12-04 10:08:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/346086e5-1ebf-47cd-b256-bc11c2cbcdde_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003634767-01984079-005.pdf)
2025-12-04 10:08:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/346086e5-1ebf-47cd-b256-bc11c2cbcdde_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003634767-01984079-005.pdf)
2025-12-04 10:08:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccc81b50>
2025-12-04 10:08:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:08:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9284d511-d309-5f25-914b-ed90b8239ecf/9284d511-d309-5f25-914b-ed90b8239ecf_image_17.jpg HTTP/1.1" 201 0
2025-12-04 10:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3684881-3998776-1004.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3684881-3998776-1004.jpg saved to cache
2025-12-04 10:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 9284d511-d309-5f25-914b-ed90b8239ecf
2025-12-04 10:08:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf6bed0>
2025-12-04 10:08:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:08:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9945aa33-abc6-54b3-9bbd-4b873e292c5f/9945aa33-abc6-54b3-9bbd-4b873e292c5f_image_11.jpg HTTP/1.1" 201 0
2025-12-04 10:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F346086e5-1ebf-47cd-b256-bc11c2cbcdde_ext_3.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/346086e5-1ebf-47cd-b256-bc11c2cbcdde_ext_3.jpg saved to cache
2025-12-04 10:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 9945aa33-abc6-54b3-9bbd-4b873e292c5f
2025-12-04 10:08:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd0f5450>
2025-12-04 10:08:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:08:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9284d511-d309-5f25-914b-ed90b8239ecf/9284d511-d309-5f25-914b-ed90b8239ecf_image_6.jpg HTTP/1.1" 201 0
2025-12-04 10:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3684881-9999999-330143646-006.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3684881-9999999-330143646-006.jpg saved to cache
2025-12-04 10:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9284d511-d309-5f25-914b-ed90b8239ecf
2025-12-04 10:08:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf6be50>
2025-12-04 10:08:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:08:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9945aa33-abc6-54b3-9bbd-4b873e292c5f/9945aa33-abc6-54b3-9bbd-4b873e292c5f_image_10.jpg HTTP/1.1" 201 0
2025-12-04 10:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F346086e5-1ebf-47cd-b256-bc11c2cbcdde_ext_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/346086e5-1ebf-47cd-b256-bc11c2cbcdde_ext_5.jpg saved to cache
2025-12-04 10:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 9945aa33-abc6-54b3-9bbd-4b873e292c5f
2025-12-04 10:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3684881-9999999-330143646-003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003684881-01983788-004.pdf)
2025-12-04 10:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003622898-01985385-004.pdf> (referer: None)
2025-12-04 10:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3684881-9999999-330143646-001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003684881-01983788-004.pdf)
2025-12-04 10:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/346086e5-1ebf-47cd-b256-bc11c2cbcdde_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003634767-01984079-005.pdf)
2025-12-04 10:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/346086e5-1ebf-47cd-b256-bc11c2cbcdde_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003634767-01984079-005.pdf)
2025-12-04 10:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/346086e5-1ebf-47cd-b256-bc11c2cbcdde_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003634767-01984079-005.pdf)
2025-12-04 10:08:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc57b450>
2025-12-04 10:08:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:08:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9284d511-d309-5f25-914b-ed90b8239ecf/9284d511-d309-5f25-914b-ed90b8239ecf_image_7.jpg HTTP/1.1" 201 0
2025-12-04 10:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3684881-9999999-330143646-007.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3684881-9999999-330143646-007.jpg saved to cache
2025-12-04 10:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9284d511-d309-5f25-914b-ed90b8239ecf
2025-12-04 10:08:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd90d90>
2025-12-04 10:08:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:08:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9284d511-d309-5f25-914b-ed90b8239ecf/9284d511-d309-5f25-914b-ed90b8239ecf_image_5.jpg HTTP/1.1" 201 0
2025-12-04 10:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3684881-9999999-330143646-005.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3684881-9999999-330143646-005.jpg saved to cache
2025-12-04 10:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9284d511-d309-5f25-914b-ed90b8239ecf
2025-12-04 10:08:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccc803d0>
2025-12-04 10:08:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:08:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9945aa33-abc6-54b3-9bbd-4b873e292c5f/9945aa33-abc6-54b3-9bbd-4b873e292c5f_image_9.jpg HTTP/1.1" 201 0
2025-12-04 10:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F346086e5-1ebf-47cd-b256-bc11c2cbcdde_ext_2.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/346086e5-1ebf-47cd-b256-bc11c2cbcdde_ext_2.jpg saved to cache
2025-12-04 10:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9945aa33-abc6-54b3-9bbd-4b873e292c5f
2025-12-04 10:08:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd0f7d90>
2025-12-04 10:08:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:08:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9945aa33-abc6-54b3-9bbd-4b873e292c5f/9945aa33-abc6-54b3-9bbd-4b873e292c5f_image_8.jpg HTTP/1.1" 201 0
2025-12-04 10:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F346086e5-1ebf-47cd-b256-bc11c2cbcdde_9.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/346086e5-1ebf-47cd-b256-bc11c2cbcdde_9.jpg saved to cache
2025-12-04 10:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9945aa33-abc6-54b3-9bbd-4b873e292c5f
2025-12-04 10:08:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 10:08:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3684881-9999999-330143646-002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003684881-01983788-004.pdf)
2025-12-04 10:08:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3677202-3976403-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003677202-01968493-004.pdf)
2025-12-04 10:08:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/03307b7a-75ba-4386-ba32-131489a9974d_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003677202-01968493-004.pdf)
2025-12-04 10:08:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/03307b7a-75ba-4386-ba32-131489a9974d_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003677202-01968493-004.pdf)
2025-12-04 10:08:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccc49810>
2025-12-04 10:08:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:08:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9284d511-d309-5f25-914b-ed90b8239ecf/9284d511-d309-5f25-914b-ed90b8239ecf_image_4.jpg HTTP/1.1" 201 0
2025-12-04 10:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3684881-9999999-330143646-003.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3684881-9999999-330143646-003.jpg saved to cache
2025-12-04 10:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9284d511-d309-5f25-914b-ed90b8239ecf
2025-12-04 10:08:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc63f590>
2025-12-04 10:08:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:08:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26ea40f5-de22-5022-b6fb-7b145e170b88/26ea40f5-de22-5022-b6fb-7b145e170b88_expert_report_file_e2ab92c1-cf6f-4cfb-be0f-61a50ce0b305.pdf HTTP/1.1" 201 0
2025-12-04 10:08:04 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 26ea40f5-de22-5022-b6fb-7b145e170b88
2025-12-04 10:08:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 26ea40f5-de22-5022-b6fb-7b145e170b88, skipping ID generation
2025-12-04 10:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 26ea40f5-de22-5022-b6fb-7b145e170b88
2025-12-04 10:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0bdf4d14-d195-4bb6-8158-eb3ff5c96ff9_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0bdf4d14-d195-4bb6-8158-eb3ff5c96ff9_ext_7.jpg not downloaded yet
2025-12-04 10:08:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccceda10>
2025-12-04 10:08:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:08:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9284d511-d309-5f25-914b-ed90b8239ecf/9284d511-d309-5f25-914b-ed90b8239ecf_image_2.jpg HTTP/1.1" 201 0
2025-12-04 10:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3684881-9999999-330143646-001.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3684881-9999999-330143646-001.jpg saved to cache
2025-12-04 10:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9284d511-d309-5f25-914b-ed90b8239ecf
2025-12-04 10:08:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc597190>
2025-12-04 10:08:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:08:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9945aa33-abc6-54b3-9bbd-4b873e292c5f/9945aa33-abc6-54b3-9bbd-4b873e292c5f_image_7.jpg HTTP/1.1" 201 0
2025-12-04 10:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F346086e5-1ebf-47cd-b256-bc11c2cbcdde_10.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/346086e5-1ebf-47cd-b256-bc11c2cbcdde_10.jpg saved to cache
2025-12-04 10:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9945aa33-abc6-54b3-9bbd-4b873e292c5f
2025-12-04 10:08:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc544f10>
2025-12-04 10:08:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:08:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9945aa33-abc6-54b3-9bbd-4b873e292c5f/9945aa33-abc6-54b3-9bbd-4b873e292c5f_image_5.jpg HTTP/1.1" 201 0
2025-12-04 10:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F346086e5-1ebf-47cd-b256-bc11c2cbcdde_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/346086e5-1ebf-47cd-b256-bc11c2cbcdde_4.jpg saved to cache
2025-12-04 10:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9945aa33-abc6-54b3-9bbd-4b873e292c5f
2025-12-04 10:08:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc67db50>
2025-12-04 10:08:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:08:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9945aa33-abc6-54b3-9bbd-4b873e292c5f/9945aa33-abc6-54b3-9bbd-4b873e292c5f_image_6.jpg HTTP/1.1" 201 0
2025-12-04 10:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F346086e5-1ebf-47cd-b256-bc11c2cbcdde_11.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/346086e5-1ebf-47cd-b256-bc11c2cbcdde_11.jpg saved to cache
2025-12-04 10:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9945aa33-abc6-54b3-9bbd-4b873e292c5f
2025-12-04 10:08:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9945aa33-abc6-54b3-9bbd-4b873e292c5f, skipping ID generation
2025-12-04 10:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 9945aa33-abc6-54b3-9bbd-4b873e292c5f from tracking dictionaries
2025-12-04 10:08:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9945aa33-abc6-54b3-9bbd-4b873e292c5f sending to next pipeline
2025-12-04 10:08:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 9945aa33-abc6-54b3-9bbd-4b873e292c5f, identifier: 3634767
2025-12-04 10:08:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 10:08:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 9945aa33-abc6-54b3-9bbd-4b873e292c5f with identifier: 3634767
2025-12-04 10:08:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 9945aa33-abc6-54b3-9bbd-4b873e292c5f with identifier: 3634767
2025-12-04 10:08:06 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 9945aa33-abc6-54b3-9bbd-4b873e292c5f with identifier: 3634767 to the API
2025-12-04 10:08:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 10:08:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 10:08:06 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/346086e5-1ebf-47cd-b256-bc11c2cbcdde_11.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9945aa33-abc6-54b3-9bbd-4b873e292c5f/9945aa33-abc6-54b3-9bbd-4b873e292c5f_expert_report_file_5483397c-7d98-4843-9d98-0948e38dab3a.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003634767-01984079-005.pdf',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '1.3L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '9945aa33-abc6-54b3-9bbd-4b873e292c5f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'YE71UUW',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=3634767',
 'listing': 'auction',
 'location': 'Bristol',
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 34655,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9945aa33-abc6-54b3-9bbd-4b873e292c5f/9945aa33-abc6-54b3-9bbd-4b873e292c5f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 255176,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/346086e5-1ebf-47cd-b256-bc11c2cbcdde_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9945aa33-abc6-54b3-9bbd-4b873e292c5f/9945aa33-abc6-54b3-9bbd-4b873e292c5f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 255176,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/346086e5-1ebf-47cd-b256-bc11c2cbcdde_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9945aa33-abc6-54b3-9bbd-4b873e292c5f/9945aa33-abc6-54b3-9bbd-4b873e292c5f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 220291,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/346086e5-1ebf-47cd-b256-bc11c2cbcdde_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9945aa33-abc6-54b3-9bbd-4b873e292c5f/9945aa33-abc6-54b3-9bbd-4b873e292c5f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 225361,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/346086e5-1ebf-47cd-b256-bc11c2cbcdde_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9945aa33-abc6-54b3-9bbd-4b873e292c5f/9945aa33-abc6-54b3-9bbd-4b873e292c5f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 212351,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/346086e5-1ebf-47cd-b256-bc11c2cbcdde_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9945aa33-abc6-54b3-9bbd-4b873e292c5f/9945aa33-abc6-54b3-9bbd-4b873e292c5f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 217840,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/346086e5-1ebf-47cd-b256-bc11c2cbcdde_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9945aa33-abc6-54b3-9bbd-4b873e292c5f/9945aa33-abc6-54b3-9bbd-4b873e292c5f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 213144,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/346086e5-1ebf-47cd-b256-bc11c2cbcdde_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9945aa33-abc6-54b3-9bbd-4b873e292c5f/9945aa33-abc6-54b3-9bbd-4b873e292c5f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 214059,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/346086e5-1ebf-47cd-b256-bc11c2cbcdde_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9945aa33-abc6-54b3-9bbd-4b873e292c5f/9945aa33-abc6-54b3-9bbd-4b873e292c5f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 204149,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/346086e5-1ebf-47cd-b256-bc11c2cbcdde_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9945aa33-abc6-54b3-9bbd-4b873e292c5f/9945aa33-abc6-54b3-9bbd-4b873e292c5f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 280676,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/346086e5-1ebf-47cd-b256-bc11c2cbcdde_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9945aa33-abc6-54b3-9bbd-4b873e292c5f/9945aa33-abc6-54b3-9bbd-4b873e292c5f_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 214928,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/346086e5-1ebf-47cd-b256-bc11c2cbcdde_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9945aa33-abc6-54b3-9bbd-4b873e292c5f/9945aa33-abc6-54b3-9bbd-4b873e292c5f_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 223003,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/346086e5-1ebf-47cd-b256-bc11c2cbcdde_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9945aa33-abc6-54b3-9bbd-4b873e292c5f/9945aa33-abc6-54b3-9bbd-4b873e292c5f_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 176111,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/346086e5-1ebf-47cd-b256-bc11c2cbcdde_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9945aa33-abc6-54b3-9bbd-4b873e292c5f/9945aa33-abc6-54b3-9bbd-4b873e292c5f_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 343789,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3634767-3998393-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9945aa33-abc6-54b3-9bbd-4b873e292c5f/9945aa33-abc6-54b3-9bbd-4b873e292c5f_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 291600,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3634767-3998393-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9945aa33-abc6-54b3-9bbd-4b873e292c5f/9945aa33-abc6-54b3-9bbd-4b873e292c5f_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 245007,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3634767-3998393-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9945aa33-abc6-54b3-9bbd-4b873e292c5f/9945aa33-abc6-54b3-9bbd-4b873e292c5f_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 334196,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3634767-3998393-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9945aa33-abc6-54b3-9bbd-4b873e292c5f/9945aa33-abc6-54b3-9bbd-4b873e292c5f_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 273188,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3634767-3998393-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9945aa33-abc6-54b3-9bbd-4b873e292c5f/9945aa33-abc6-54b3-9bbd-4b873e292c5f_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 185227,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3634767-3998393-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9945aa33-abc6-54b3-9bbd-4b873e292c5f/9945aa33-abc6-54b3-9bbd-4b873e292c5f_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 461162,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3634767-3998393-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-23',
 'seller_name': 'Mobilize Financial Services',
 'title': 'NISSAN QASHQAI 1.3 DiG-T MH Acenta Premium 5dr',
 'transmission': 'manual',
 'trim': '1.3 DiG-T MH Acenta Premium 5dr',
 'year': 2021}
2025-12-04 10:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273634767%27 HTTP/1.1" 200 None
2025-12-04 10:08:06 [manheim.gb] INFO: Saving data for 3634767: {'created_time': 1764842886.600843, 'last_price_update_time': 1764842886.600854, 'auction_closing_time': 1765270800.0}
2025-12-04 10:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3634767') HTTP/1.1" 204 0
2025-12-04 10:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0bdf4d14-d195-4bb6-8158-eb3ff5c96ff9_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0bdf4d14-d195-4bb6-8158-eb3ff5c96ff9_ext_7.jpg not downloaded yet
2025-12-04 10:08:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0000363011-01983801-002.pdf> (referer: None)
2025-12-04 10:08:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/03307b7a-75ba-4386-ba32-131489a9974d_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003677202-01968493-004.pdf)
2025-12-04 10:08:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/03ec0254-4d90-4b3a-bada-4e8408ad022f_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003693298-1001400926-002.pdf)
2025-12-04 10:08:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/03307b7a-75ba-4386-ba32-131489a9974d_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003677202-01968493-004.pdf)
2025-12-04 10:08:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/03307b7a-75ba-4386-ba32-131489a9974d_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003677202-01968493-004.pdf)
2025-12-04 10:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0bdf4d14-d195-4bb6-8158-eb3ff5c96ff9_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0bdf4d14-d195-4bb6-8158-eb3ff5c96ff9_ext_6.jpg not downloaded yet
2025-12-04 10:08:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/03ec0254-4d90-4b3a-bada-4e8408ad022f_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003693298-1001400926-002.pdf)
2025-12-04 10:08:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/03307b7a-75ba-4386-ba32-131489a9974d_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003677202-01968493-004.pdf)
2025-12-04 10:08:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd77150>
2025-12-04 10:08:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:08:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9284d511-d309-5f25-914b-ed90b8239ecf/9284d511-d309-5f25-914b-ed90b8239ecf_image_3.jpg HTTP/1.1" 201 0
2025-12-04 10:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3684881-9999999-330143646-002.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3684881-9999999-330143646-002.jpg saved to cache
2025-12-04 10:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9284d511-d309-5f25-914b-ed90b8239ecf
2025-12-04 10:08:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9284d511-d309-5f25-914b-ed90b8239ecf, skipping ID generation
2025-12-04 10:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 9284d511-d309-5f25-914b-ed90b8239ecf from tracking dictionaries
2025-12-04 10:08:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9284d511-d309-5f25-914b-ed90b8239ecf sending to next pipeline
2025-12-04 10:08:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 9284d511-d309-5f25-914b-ed90b8239ecf, identifier: 3684881
2025-12-04 10:08:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf6b490>
2025-12-04 10:08:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:08:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2fbbc445-b915-58e2-ba7a-9c92dc3e12e7/2fbbc445-b915-58e2-ba7a-9c92dc3e12e7_image_13.jpg HTTP/1.1" 201 0
2025-12-04 10:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3677202-3976403-13.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3677202-3976403-13.jpg saved to cache
2025-12-04 10:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 2fbbc445-b915-58e2-ba7a-9c92dc3e12e7
2025-12-04 10:08:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5bc690>
2025-12-04 10:08:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:08:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2fbbc445-b915-58e2-ba7a-9c92dc3e12e7/2fbbc445-b915-58e2-ba7a-9c92dc3e12e7_image_12.jpg HTTP/1.1" 201 0
2025-12-04 10:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F03307b7a-75ba-4386-ba32-131489a9974d_ext_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/03307b7a-75ba-4386-ba32-131489a9974d_ext_4.jpg saved to cache
2025-12-04 10:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 2fbbc445-b915-58e2-ba7a-9c92dc3e12e7
2025-12-04 10:08:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6494d0>
2025-12-04 10:08:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:08:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2fbbc445-b915-58e2-ba7a-9c92dc3e12e7/2fbbc445-b915-58e2-ba7a-9c92dc3e12e7_image_11.jpg HTTP/1.1" 201 0
2025-12-04 10:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F03307b7a-75ba-4386-ba32-131489a9974d_ext_3.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/03307b7a-75ba-4386-ba32-131489a9974d_ext_3.jpg saved to cache
2025-12-04 10:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 2fbbc445-b915-58e2-ba7a-9c92dc3e12e7
2025-12-04 10:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0bdf4d14-d195-4bb6-8158-eb3ff5c96ff9_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0bdf4d14-d195-4bb6-8158-eb3ff5c96ff9_ext_1.jpg not downloaded yet
2025-12-04 10:08:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 9284d511-d309-5f25-914b-ed90b8239ecf with identifier: 3684881
2025-12-04 10:08:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 9284d511-d309-5f25-914b-ed90b8239ecf with identifier: 3684881
2025-12-04 10:08:08 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 9284d511-d309-5f25-914b-ed90b8239ecf with identifier: 3684881 to the API
2025-12-04 10:08:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 10:08:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 10:08:08 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/3684881-9999999-330143646-002.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 145,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9284d511-d309-5f25-914b-ed90b8239ecf/9284d511-d309-5f25-914b-ed90b8239ecf_expert_report_file_f3f457c4-9142-4e3a-8fcb-61688fe9b4de.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003684881-01983788-004.pdf',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '1.3L',
 'expiration_date': '2025-12-05T09:00:00Z',
 'fuel_type': 'Petrol/Hybrid',
 'id': '9284d511-d309-5f25-914b-ed90b8239ecf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'YB71LXD',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=3684881',
 'listing': 'auction',
 'location': 'Washington',
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 88618,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9284d511-d309-5f25-914b-ed90b8239ecf/9284d511-d309-5f25-914b-ed90b8239ecf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 286678,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3684881-9999999-330143646-004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9284d511-d309-5f25-914b-ed90b8239ecf/9284d511-d309-5f25-914b-ed90b8239ecf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 243146,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3684881-9999999-330143646-008.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9284d511-d309-5f25-914b-ed90b8239ecf/9284d511-d309-5f25-914b-ed90b8239ecf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 209697,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3684881-9999999-330143646-001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9284d511-d309-5f25-914b-ed90b8239ecf/9284d511-d309-5f25-914b-ed90b8239ecf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 281180,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3684881-9999999-330143646-002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9284d511-d309-5f25-914b-ed90b8239ecf/9284d511-d309-5f25-914b-ed90b8239ecf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 267582,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3684881-9999999-330143646-003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9284d511-d309-5f25-914b-ed90b8239ecf/9284d511-d309-5f25-914b-ed90b8239ecf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 300015,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3684881-9999999-330143646-005.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9284d511-d309-5f25-914b-ed90b8239ecf/9284d511-d309-5f25-914b-ed90b8239ecf_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 251938,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3684881-9999999-330143646-006.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9284d511-d309-5f25-914b-ed90b8239ecf/9284d511-d309-5f25-914b-ed90b8239ecf_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 270491,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3684881-9999999-330143646-007.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9284d511-d309-5f25-914b-ed90b8239ecf/9284d511-d309-5f25-914b-ed90b8239ecf_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 249638,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3684881-9999999-330143646-009.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9284d511-d309-5f25-914b-ed90b8239ecf/9284d511-d309-5f25-914b-ed90b8239ecf_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 178393,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3684881-9999999-330143646-010.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9284d511-d309-5f25-914b-ed90b8239ecf/9284d511-d309-5f25-914b-ed90b8239ecf_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 194559,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3684881-9999999-330143646-011.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9284d511-d309-5f25-914b-ed90b8239ecf/9284d511-d309-5f25-914b-ed90b8239ecf_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 193987,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3684881-9999999-330143646-012.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9284d511-d309-5f25-914b-ed90b8239ecf/9284d511-d309-5f25-914b-ed90b8239ecf_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 434505,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3684881-3998776-13.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9284d511-d309-5f25-914b-ed90b8239ecf/9284d511-d309-5f25-914b-ed90b8239ecf_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 270771,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3684881-3998776-1000.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9284d511-d309-5f25-914b-ed90b8239ecf/9284d511-d309-5f25-914b-ed90b8239ecf_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 272473,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3684881-3998776-1001.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9284d511-d309-5f25-914b-ed90b8239ecf/9284d511-d309-5f25-914b-ed90b8239ecf_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 197642,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3684881-3998776-1002.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9284d511-d309-5f25-914b-ed90b8239ecf/9284d511-d309-5f25-914b-ed90b8239ecf_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 277121,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3684881-3998776-1003.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9284d511-d309-5f25-914b-ed90b8239ecf/9284d511-d309-5f25-914b-ed90b8239ecf_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 342838,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3684881-3998776-1004.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9284d511-d309-5f25-914b-ed90b8239ecf/9284d511-d309-5f25-914b-ed90b8239ecf_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 259024,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3684881-3998776-1005.jpg',
             'Width': 1500}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-31',
 'seller_name': 'Pulman Group Direct',
 'title': 'NISSAN QASHQAI 1.3 DiG-T MH N-Connecta 5dr',
 'transmission': 'manual',
 'trim': '1.3 DiG-T MH N-Connecta 5dr',
 'year': 2021}
2025-12-04 10:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273684881%27 HTTP/1.1" 200 None
2025-12-04 10:08:08 [manheim.gb] INFO: Saving data for 3684881: {'created_time': 1764842888.805737, 'last_price_update_time': 1764842888.805749, 'auction_closing_time': 1764925200.0}
2025-12-04 10:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3684881') HTTP/1.1" 204 0
2025-12-04 10:08:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1564179-4007572-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001564179-01991001-001.pdf)
2025-12-04 10:08:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/03ec0254-4d90-4b3a-bada-4e8408ad022f_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003693298-1001400926-002.pdf)
2025-12-04 10:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0bdf4d14-d195-4bb6-8158-eb3ff5c96ff9_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0bdf4d14-d195-4bb6-8158-eb3ff5c96ff9_5.jpg not downloaded yet
2025-12-04 10:08:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccefcdd0>
2025-12-04 10:08:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:08:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ba9d830-17c9-5bf8-86a6-04450b3e9296/1ba9d830-17c9-5bf8-86a6-04450b3e9296_expert_report_file_32b74b18-b752-40ed-b9b8-5886214ba359.pdf HTTP/1.1" 201 0
2025-12-04 10:08:09 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 1ba9d830-17c9-5bf8-86a6-04450b3e9296
2025-12-04 10:08:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1ba9d830-17c9-5bf8-86a6-04450b3e9296, skipping ID generation
2025-12-04 10:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 1ba9d830-17c9-5bf8-86a6-04450b3e9296
2025-12-04 10:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4e818afe-691b-4309-9d5c-6e489056b5f3_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4e818afe-691b-4309-9d5c-6e489056b5f3_ext_7.jpg not downloaded yet
2025-12-04 10:08:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6cf190>
2025-12-04 10:08:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:08:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2fbbc445-b915-58e2-ba7a-9c92dc3e12e7/2fbbc445-b915-58e2-ba7a-9c92dc3e12e7_image_6.jpg HTTP/1.1" 201 0
2025-12-04 10:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F03307b7a-75ba-4386-ba32-131489a9974d_11.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/03307b7a-75ba-4386-ba32-131489a9974d_11.jpg saved to cache
2025-12-04 10:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2fbbc445-b915-58e2-ba7a-9c92dc3e12e7
2025-12-04 10:08:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5eb190>
2025-12-04 10:08:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:08:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df58e7f8-61e7-56dd-9423-3b35c4acd52f/df58e7f8-61e7-56dd-9423-3b35c4acd52f_image_6.jpg HTTP/1.1" 201 0
2025-12-04 10:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F03ec0254-4d90-4b3a-bada-4e8408ad022f_11.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/03ec0254-4d90-4b3a-bada-4e8408ad022f_11.jpg saved to cache
2025-12-04 10:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item df58e7f8-61e7-56dd-9423-3b35c4acd52f
2025-12-04 10:08:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6f1710>
2025-12-04 10:08:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:08:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2fbbc445-b915-58e2-ba7a-9c92dc3e12e7/2fbbc445-b915-58e2-ba7a-9c92dc3e12e7_image_10.jpg HTTP/1.1" 201 0
2025-12-04 10:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F03307b7a-75ba-4386-ba32-131489a9974d_ext_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/03307b7a-75ba-4386-ba32-131489a9974d_ext_5.jpg saved to cache
2025-12-04 10:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 2fbbc445-b915-58e2-ba7a-9c92dc3e12e7
2025-12-04 10:08:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd11990>
2025-12-04 10:08:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:08:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2fbbc445-b915-58e2-ba7a-9c92dc3e12e7/2fbbc445-b915-58e2-ba7a-9c92dc3e12e7_image_8.jpg HTTP/1.1" 201 0
2025-12-04 10:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F03307b7a-75ba-4386-ba32-131489a9974d_9.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/03307b7a-75ba-4386-ba32-131489a9974d_9.jpg saved to cache
2025-12-04 10:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2fbbc445-b915-58e2-ba7a-9c92dc3e12e7
2025-12-04 10:08:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5c3190>
2025-12-04 10:08:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:08:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df58e7f8-61e7-56dd-9423-3b35c4acd52f/df58e7f8-61e7-56dd-9423-3b35c4acd52f_image_8.jpg HTTP/1.1" 201 0
2025-12-04 10:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F03ec0254-4d90-4b3a-bada-4e8408ad022f_9.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/03ec0254-4d90-4b3a-bada-4e8408ad022f_9.jpg saved to cache
2025-12-04 10:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item df58e7f8-61e7-56dd-9423-3b35c4acd52f
2025-12-04 10:08:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5c0e10>
2025-12-04 10:08:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:08:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2fbbc445-b915-58e2-ba7a-9c92dc3e12e7/2fbbc445-b915-58e2-ba7a-9c92dc3e12e7_image_9.jpg HTTP/1.1" 201 0
2025-12-04 10:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F03307b7a-75ba-4386-ba32-131489a9974d_ext_2.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/03307b7a-75ba-4386-ba32-131489a9974d_ext_2.jpg saved to cache
2025-12-04 10:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2fbbc445-b915-58e2-ba7a-9c92dc3e12e7
2025-12-04 10:08:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2fbbc445-b915-58e2-ba7a-9c92dc3e12e7, skipping ID generation
2025-12-04 10:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 2fbbc445-b915-58e2-ba7a-9c92dc3e12e7 from tracking dictionaries
2025-12-04 10:08:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2fbbc445-b915-58e2-ba7a-9c92dc3e12e7 sending to next pipeline
2025-12-04 10:08:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 2fbbc445-b915-58e2-ba7a-9c92dc3e12e7, identifier: 3677202
2025-12-04 10:08:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 2fbbc445-b915-58e2-ba7a-9c92dc3e12e7 with identifier: 3677202
2025-12-04 10:08:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 2fbbc445-b915-58e2-ba7a-9c92dc3e12e7 with identifier: 3677202
2025-12-04 10:08:11 [scrapy.core.scraper] INFO: Dropped: Dropping expired listing: 2fbbc445-b915-58e2-ba7a-9c92dc3e12e7 with expiration date: 2025-12-04T09:00:00Z
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2fbbc445-b915-58e2-ba7a-9c92dc3e12e7/2fbbc445-b915-58e2-ba7a-9c92dc3e12e7_expert_report_file_f3d957b0-8c9d-464d-ad61-a89cc51978e2.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003677202-01968493-004.pdf',
 'color': 'BLUE',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '2fbbc445-b915-58e2-ba7a-9c92dc3e12e7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'VK22WKF',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VAUXHALL/CORSA?id=3677202',
 'listing': 'auction',
 'location': 'Shotts',
 'make': 'VAUXHALL',
 'model': 'CORSA',
 'odometer': 22960,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 37,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2fbbc445-b915-58e2-ba7a-9c92dc3e12e7/2fbbc445-b915-58e2-ba7a-9c92dc3e12e7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 147816,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/03307b7a-75ba-4386-ba32-131489a9974d_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2fbbc445-b915-58e2-ba7a-9c92dc3e12e7/2fbbc445-b915-58e2-ba7a-9c92dc3e12e7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 147816,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/03307b7a-75ba-4386-ba32-131489a9974d_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2fbbc445-b915-58e2-ba7a-9c92dc3e12e7/2fbbc445-b915-58e2-ba7a-9c92dc3e12e7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 208037,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/03307b7a-75ba-4386-ba32-131489a9974d_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2fbbc445-b915-58e2-ba7a-9c92dc3e12e7/2fbbc445-b915-58e2-ba7a-9c92dc3e12e7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 126291,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/03307b7a-75ba-4386-ba32-131489a9974d_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2fbbc445-b915-58e2-ba7a-9c92dc3e12e7/2fbbc445-b915-58e2-ba7a-9c92dc3e12e7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 148374,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/03307b7a-75ba-4386-ba32-131489a9974d_5.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2fbbc445-b915-58e2-ba7a-9c92dc3e12e7/2fbbc445-b915-58e2-ba7a-9c92dc3e12e7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 146099,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/03307b7a-75ba-4386-ba32-131489a9974d_4.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2fbbc445-b915-58e2-ba7a-9c92dc3e12e7/2fbbc445-b915-58e2-ba7a-9c92dc3e12e7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 146621,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/03307b7a-75ba-4386-ba32-131489a9974d_11.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2fbbc445-b915-58e2-ba7a-9c92dc3e12e7/2fbbc445-b915-58e2-ba7a-9c92dc3e12e7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 140649,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/03307b7a-75ba-4386-ba32-131489a9974d_10.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2fbbc445-b915-58e2-ba7a-9c92dc3e12e7/2fbbc445-b915-58e2-ba7a-9c92dc3e12e7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 146990,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/03307b7a-75ba-4386-ba32-131489a9974d_9.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2fbbc445-b915-58e2-ba7a-9c92dc3e12e7/2fbbc445-b915-58e2-ba7a-9c92dc3e12e7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 246768,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/03307b7a-75ba-4386-ba32-131489a9974d_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2fbbc445-b915-58e2-ba7a-9c92dc3e12e7/2fbbc445-b915-58e2-ba7a-9c92dc3e12e7_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 188089,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/03307b7a-75ba-4386-ba32-131489a9974d_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2fbbc445-b915-58e2-ba7a-9c92dc3e12e7/2fbbc445-b915-58e2-ba7a-9c92dc3e12e7_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 203275,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/03307b7a-75ba-4386-ba32-131489a9974d_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2fbbc445-b915-58e2-ba7a-9c92dc3e12e7/2fbbc445-b915-58e2-ba7a-9c92dc3e12e7_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 235248,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/03307b7a-75ba-4386-ba32-131489a9974d_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2fbbc445-b915-58e2-ba7a-9c92dc3e12e7/2fbbc445-b915-58e2-ba7a-9c92dc3e12e7_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 360580,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3677202-3976403-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2fbbc445-b915-58e2-ba7a-9c92dc3e12e7/2fbbc445-b915-58e2-ba7a-9c92dc3e12e7_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 267714,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3677202-3976403-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2fbbc445-b915-58e2-ba7a-9c92dc3e12e7/2fbbc445-b915-58e2-ba7a-9c92dc3e12e7_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 255313,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3677202-3976403-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2fbbc445-b915-58e2-ba7a-9c92dc3e12e7/2fbbc445-b915-58e2-ba7a-9c92dc3e12e7_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 245446,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3677202-3976403-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2fbbc445-b915-58e2-ba7a-9c92dc3e12e7/2fbbc445-b915-58e2-ba7a-9c92dc3e12e7_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 321255,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3677202-3976403-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2fbbc445-b915-58e2-ba7a-9c92dc3e12e7/2fbbc445-b915-58e2-ba7a-9c92dc3e12e7_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 316284,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3677202-3976403-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2fbbc445-b915-58e2-ba7a-9c92dc3e12e7/2fbbc445-b915-58e2-ba7a-9c92dc3e12e7_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 236917,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3677202-3976403-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-31',
 'seller_name': 'Leasys',
 'title': 'VAUXHALL CORSA 1.2 Turbo Elite Edition 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.2 Turbo Elite Edition 5dr Auto',
 'year': 2022}
2025-12-04 10:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273677202%27 HTTP/1.1" 200 None
2025-12-04 10:08:11 [manheim.gb] INFO: Saving data for 3677202: {'created_time': 1764842891.26653, 'last_price_update_time': 1764842891.26654, 'auction_closing_time': 1764838800.0}
2025-12-04 10:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3677202') HTTP/1.1" 204 0
2025-12-04 10:08:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0bdf4d14-d195-4bb6-8158-eb3ff5c96ff9_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003622898-01985385-004.pdf)
2025-12-04 10:08:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/79d3f9d2-f35f-4d29-ae30-54140900dd77_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001966868-01991002-001.pdf)
2025-12-04 10:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0bdf4d14-d195-4bb6-8158-eb3ff5c96ff9_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0bdf4d14-d195-4bb6-8158-eb3ff5c96ff9_4.jpg not downloaded yet
2025-12-04 10:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4e818afe-691b-4309-9d5c-6e489056b5f3_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4e818afe-691b-4309-9d5c-6e489056b5f3_ext_7.jpg not downloaded yet
2025-12-04 10:08:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc600190>
2025-12-04 10:08:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:08:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9200c31a-aec5-5dca-8036-0876fcfb70f2/9200c31a-aec5-5dca-8036-0876fcfb70f2_image_16.jpg HTTP/1.1" 201 0
2025-12-04 10:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1564179-4007572-1002.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1564179-4007572-1002.jpg saved to cache
2025-12-04 10:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 9200c31a-aec5-5dca-8036-0876fcfb70f2
2025-12-04 10:08:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6001d0>
2025-12-04 10:08:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:08:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df58e7f8-61e7-56dd-9423-3b35c4acd52f/df58e7f8-61e7-56dd-9423-3b35c4acd52f_image_3.jpg HTTP/1.1" 201 0
2025-12-04 10:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F03ec0254-4d90-4b3a-bada-4e8408ad022f_ext_1.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/03ec0254-4d90-4b3a-bada-4e8408ad022f_ext_1.jpg saved to cache
2025-12-04 10:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item df58e7f8-61e7-56dd-9423-3b35c4acd52f
2025-12-04 10:08:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: df58e7f8-61e7-56dd-9423-3b35c4acd52f, skipping ID generation
2025-12-04 10:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Removing item df58e7f8-61e7-56dd-9423-3b35c4acd52f from tracking dictionaries
2025-12-04 10:08:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item df58e7f8-61e7-56dd-9423-3b35c4acd52f sending to next pipeline
2025-12-04 10:08:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: df58e7f8-61e7-56dd-9423-3b35c4acd52f, identifier: 3693298
2025-12-04 10:08:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1761741-4007528-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001761741-01991419-003.pdf)
2025-12-04 10:08:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: df58e7f8-61e7-56dd-9423-3b35c4acd52f with identifier: 3693298
2025-12-04 10:08:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: df58e7f8-61e7-56dd-9423-3b35c4acd52f with identifier: 3693298
2025-12-04 10:08:12 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: df58e7f8-61e7-56dd-9423-3b35c4acd52f with identifier: 3693298 to the API
2025-12-04 10:08:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 10:08:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 10:08:12 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/03ec0254-4d90-4b3a-bada-4e8408ad022f_ext_1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df58e7f8-61e7-56dd-9423-3b35c4acd52f/df58e7f8-61e7-56dd-9423-3b35c4acd52f_expert_report_file_3d0c97c7-3d47-43a2-84c1-f831f08b738c.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003693298-1001400926-002.pdf',
 'color': 'RED',
 'currency': 'GBP',
 'engine': '1.4L',
 'expiration_date': '2025-12-16T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'df58e7f8-61e7-56dd-9423-3b35c4acd52f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'CK17LDO',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VAUXHALL/ASTRA?id=3693298',
 'listing': 'auction',
 'location': 'Bristol',
 'make': 'VAUXHALL',
 'model': 'ASTRA',
 'odometer': 85562,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 35,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df58e7f8-61e7-56dd-9423-3b35c4acd52f/df58e7f8-61e7-56dd-9423-3b35c4acd52f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 211236,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/03ec0254-4d90-4b3a-bada-4e8408ad022f_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df58e7f8-61e7-56dd-9423-3b35c4acd52f/df58e7f8-61e7-56dd-9423-3b35c4acd52f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 211236,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/03ec0254-4d90-4b3a-bada-4e8408ad022f_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df58e7f8-61e7-56dd-9423-3b35c4acd52f/df58e7f8-61e7-56dd-9423-3b35c4acd52f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 332969,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/03ec0254-4d90-4b3a-bada-4e8408ad022f_ext_6.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df58e7f8-61e7-56dd-9423-3b35c4acd52f/df58e7f8-61e7-56dd-9423-3b35c4acd52f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 266803,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/03ec0254-4d90-4b3a-bada-4e8408ad022f_ext_1.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df58e7f8-61e7-56dd-9423-3b35c4acd52f/df58e7f8-61e7-56dd-9423-3b35c4acd52f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 194097,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/03ec0254-4d90-4b3a-bada-4e8408ad022f_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df58e7f8-61e7-56dd-9423-3b35c4acd52f/df58e7f8-61e7-56dd-9423-3b35c4acd52f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 176392,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/03ec0254-4d90-4b3a-bada-4e8408ad022f_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df58e7f8-61e7-56dd-9423-3b35c4acd52f/df58e7f8-61e7-56dd-9423-3b35c4acd52f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 194235,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/03ec0254-4d90-4b3a-bada-4e8408ad022f_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df58e7f8-61e7-56dd-9423-3b35c4acd52f/df58e7f8-61e7-56dd-9423-3b35c4acd52f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 184011,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/03ec0254-4d90-4b3a-bada-4e8408ad022f_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df58e7f8-61e7-56dd-9423-3b35c4acd52f/df58e7f8-61e7-56dd-9423-3b35c4acd52f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 200001,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/03ec0254-4d90-4b3a-bada-4e8408ad022f_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df58e7f8-61e7-56dd-9423-3b35c4acd52f/df58e7f8-61e7-56dd-9423-3b35c4acd52f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 308109,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/03ec0254-4d90-4b3a-bada-4e8408ad022f_ext_2.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df58e7f8-61e7-56dd-9423-3b35c4acd52f/df58e7f8-61e7-56dd-9423-3b35c4acd52f_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 282271,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/03ec0254-4d90-4b3a-bada-4e8408ad022f_ext_5.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df58e7f8-61e7-56dd-9423-3b35c4acd52f/df58e7f8-61e7-56dd-9423-3b35c4acd52f_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 260934,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/03ec0254-4d90-4b3a-bada-4e8408ad022f_ext_3.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df58e7f8-61e7-56dd-9423-3b35c4acd52f/df58e7f8-61e7-56dd-9423-3b35c4acd52f_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 281739,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/03ec0254-4d90-4b3a-bada-4e8408ad022f_ext_4.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df58e7f8-61e7-56dd-9423-3b35c4acd52f/df58e7f8-61e7-56dd-9423-3b35c4acd52f_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 162896,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3693298-3631035-13.jpg',
             'Width': 1000},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df58e7f8-61e7-56dd-9423-3b35c4acd52f/df58e7f8-61e7-56dd-9423-3b35c4acd52f_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 143941,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3693298-3631035-1000.jpg',
             'Width': 1000},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df58e7f8-61e7-56dd-9423-3b35c4acd52f/df58e7f8-61e7-56dd-9423-3b35c4acd52f_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 204235,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3693298-3631035-1001.jpg',
             'Width': 1000},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df58e7f8-61e7-56dd-9423-3b35c4acd52f/df58e7f8-61e7-56dd-9423-3b35c4acd52f_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 125165,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3693298-3631035-1002.jpg',
             'Width': 1000},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df58e7f8-61e7-56dd-9423-3b35c4acd52f/df58e7f8-61e7-56dd-9423-3b35c4acd52f_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 248796,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3693298-3631035-1003.jpg',
             'Width': 1000},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df58e7f8-61e7-56dd-9423-3b35c4acd52f/df58e7f8-61e7-56dd-9423-3b35c4acd52f_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 201604,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3693298-3631035-1004.jpg',
             'Width': 1000},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df58e7f8-61e7-56dd-9423-3b35c4acd52f/df58e7f8-61e7-56dd-9423-3b35c4acd52f_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 163069,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3693298-3631035-1005.jpg',
             'Width': 1000}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-24',
 'seller_name': 'Santander Consumer',
 'title': 'VAUXHALL ASTRA 1.4i 16V SRi 5dr',
 'transmission': 'manual',
 'trim': '1.4i 16V SRi 5dr',
 'year': 2017}
2025-12-04 10:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273693298%27 HTTP/1.1" 200 None
2025-12-04 10:08:12 [manheim.gb] INFO: Saving data for 3693298: {'created_time': 1764842892.545002, 'last_price_update_time': 1764842892.545016, 'auction_closing_time': 1765875600.0}
2025-12-04 10:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3693298') HTTP/1.1" 204 0
2025-12-04 10:08:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 10:08:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 10:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0bdf4d14-d195-4bb6-8158-eb3ff5c96ff9_11.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0bdf4d14-d195-4bb6-8158-eb3ff5c96ff9_11.jpg not downloaded yet
2025-12-04 10:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4e818afe-691b-4309-9d5c-6e489056b5f3_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4e818afe-691b-4309-9d5c-6e489056b5f3_ext_6.jpg not downloaded yet
2025-12-04 10:08:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5c01d0>
2025-12-04 10:08:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:08:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26ea40f5-de22-5022-b6fb-7b145e170b88/26ea40f5-de22-5022-b6fb-7b145e170b88_image_0.jpg HTTP/1.1" 201 0
2025-12-04 10:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0bdf4d14-d195-4bb6-8158-eb3ff5c96ff9_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0bdf4d14-d195-4bb6-8158-eb3ff5c96ff9_ext_7.jpg saved to cache
2025-12-04 10:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 26ea40f5-de22-5022-b6fb-7b145e170b88
2025-12-04 10:08:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccdd2c50>
2025-12-04 10:08:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:08:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_941069ff-ef30-5bba-82bd-388d3cb54f16/941069ff-ef30-5bba-82bd-388d3cb54f16_image_0.jpg HTTP/1.1" 201 0
2025-12-04 10:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F79d3f9d2-f35f-4d29-ae30-54140900dd77_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/79d3f9d2-f35f-4d29-ae30-54140900dd77_ext_7.jpg saved to cache
2025-12-04 10:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 941069ff-ef30-5bba-82bd-388d3cb54f16
2025-12-04 10:08:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 941069ff-ef30-5bba-82bd-388d3cb54f16, skipping ID generation
2025-12-04 10:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 941069ff-ef30-5bba-82bd-388d3cb54f16 from tracking dictionaries
2025-12-04 10:08:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 941069ff-ef30-5bba-82bd-388d3cb54f16 sending to next pipeline
2025-12-04 10:08:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 941069ff-ef30-5bba-82bd-388d3cb54f16, identifier: 1966868
2025-12-04 10:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0bdf4d14-d195-4bb6-8158-eb3ff5c96ff9_10.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0bdf4d14-d195-4bb6-8158-eb3ff5c96ff9_10.jpg not downloaded yet
2025-12-04 10:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4e818afe-691b-4309-9d5c-6e489056b5f3_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4e818afe-691b-4309-9d5c-6e489056b5f3_ext_1.jpg not downloaded yet
2025-12-04 10:08:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 941069ff-ef30-5bba-82bd-388d3cb54f16 with identifier: 1966868
2025-12-04 10:08:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 941069ff-ef30-5bba-82bd-388d3cb54f16 with identifier: 1966868
2025-12-04 10:08:13 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 941069ff-ef30-5bba-82bd-388d3cb54f16 with identifier: 1966868 to the API
2025-12-04 10:08:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 10:08:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 10:08:13 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/79d3f9d2-f35f-4d29-ae30-54140900dd77_ext_7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_941069ff-ef30-5bba-82bd-388d3cb54f16/941069ff-ef30-5bba-82bd-388d3cb54f16_expert_report_file_353096cd-c885-40fb-9c4a-6e4cd62b281f.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001966868-01991002-001.pdf',
 'color': 'BLUE',
 'currency': 'GBP',
 'engine': '1.5L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '941069ff-ef30-5bba-82bd-388d3cb54f16',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'BN16GEK',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=1966868',
 'listing': 'auction',
 'location': 'Leeds',
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 71346,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 27,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_941069ff-ef30-5bba-82bd-388d3cb54f16/941069ff-ef30-5bba-82bd-388d3cb54f16_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 208392,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/79d3f9d2-f35f-4d29-ae30-54140900dd77_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_941069ff-ef30-5bba-82bd-388d3cb54f16/941069ff-ef30-5bba-82bd-388d3cb54f16_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 208392,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/79d3f9d2-f35f-4d29-ae30-54140900dd77_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_941069ff-ef30-5bba-82bd-388d3cb54f16/941069ff-ef30-5bba-82bd-388d3cb54f16_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 285367,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/79d3f9d2-f35f-4d29-ae30-54140900dd77_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_941069ff-ef30-5bba-82bd-388d3cb54f16/941069ff-ef30-5bba-82bd-388d3cb54f16_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 175801,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/79d3f9d2-f35f-4d29-ae30-54140900dd77_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_941069ff-ef30-5bba-82bd-388d3cb54f16/941069ff-ef30-5bba-82bd-388d3cb54f16_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 194732,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/79d3f9d2-f35f-4d29-ae30-54140900dd77_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_941069ff-ef30-5bba-82bd-388d3cb54f16/941069ff-ef30-5bba-82bd-388d3cb54f16_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 190803,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/79d3f9d2-f35f-4d29-ae30-54140900dd77_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_941069ff-ef30-5bba-82bd-388d3cb54f16/941069ff-ef30-5bba-82bd-388d3cb54f16_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 196906,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/79d3f9d2-f35f-4d29-ae30-54140900dd77_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_941069ff-ef30-5bba-82bd-388d3cb54f16/941069ff-ef30-5bba-82bd-388d3cb54f16_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 186952,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/79d3f9d2-f35f-4d29-ae30-54140900dd77_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_941069ff-ef30-5bba-82bd-388d3cb54f16/941069ff-ef30-5bba-82bd-388d3cb54f16_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 196841,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/79d3f9d2-f35f-4d29-ae30-54140900dd77_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_941069ff-ef30-5bba-82bd-388d3cb54f16/941069ff-ef30-5bba-82bd-388d3cb54f16_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 243907,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/79d3f9d2-f35f-4d29-ae30-54140900dd77_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_941069ff-ef30-5bba-82bd-388d3cb54f16/941069ff-ef30-5bba-82bd-388d3cb54f16_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 232807,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/79d3f9d2-f35f-4d29-ae30-54140900dd77_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_941069ff-ef30-5bba-82bd-388d3cb54f16/941069ff-ef30-5bba-82bd-388d3cb54f16_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 223361,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/79d3f9d2-f35f-4d29-ae30-54140900dd77_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_941069ff-ef30-5bba-82bd-388d3cb54f16/941069ff-ef30-5bba-82bd-388d3cb54f16_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 250648,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/79d3f9d2-f35f-4d29-ae30-54140900dd77_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_941069ff-ef30-5bba-82bd-388d3cb54f16/941069ff-ef30-5bba-82bd-388d3cb54f16_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 248329,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1966868-4007672-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_941069ff-ef30-5bba-82bd-388d3cb54f16/941069ff-ef30-5bba-82bd-388d3cb54f16_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 182819,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1966868-4007672-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_941069ff-ef30-5bba-82bd-388d3cb54f16/941069ff-ef30-5bba-82bd-388d3cb54f16_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 238868,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1966868-4007672-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_941069ff-ef30-5bba-82bd-388d3cb54f16/941069ff-ef30-5bba-82bd-388d3cb54f16_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 243064,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1966868-4007672-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_941069ff-ef30-5bba-82bd-388d3cb54f16/941069ff-ef30-5bba-82bd-388d3cb54f16_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 244023,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1966868-4007672-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_941069ff-ef30-5bba-82bd-388d3cb54f16/941069ff-ef30-5bba-82bd-388d3cb54f16_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 204455,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1966868-4007672-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_941069ff-ef30-5bba-82bd-388d3cb54f16/941069ff-ef30-5bba-82bd-388d3cb54f16_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 270961,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1966868-4007672-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-04',
 'seller_name': 'Big Motoring World Ltd',
 'title': 'NISSAN QASHQAI 1.5 dCi Tekna [Non-Panoramic] 5dr',
 'transmission': 'manual',
 'trim': '1.5 dCi Tekna [Non-Panoramic] 5dr',
 'year': 2016}
2025-12-04 10:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271966868%27 HTTP/1.1" 200 None
2025-12-04 10:08:13 [manheim.gb] INFO: Saving data for 1966868: {'created_time': 1764842893.866226, 'last_price_update_time': 1764842893.866238, 'auction_closing_time': 1765184400.0}
2025-12-04 10:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1966868') HTTP/1.1" 204 0
2025-12-04 10:08:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6d9b10>
2025-12-04 10:08:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:08:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08d45d44-06c8-5777-ab82-d212449d4408/08d45d44-06c8-5777-ab82-d212449d4408_image_16.jpg HTTP/1.1" 201 0
2025-12-04 10:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1761741-4007528-1002.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1761741-4007528-1002.jpg saved to cache
2025-12-04 10:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 08d45d44-06c8-5777-ab82-d212449d4408
2025-12-04 10:08:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1564179-4007572-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001564179-01991001-001.pdf)
2025-12-04 10:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0bdf4d14-d195-4bb6-8158-eb3ff5c96ff9_9.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0bdf4d14-d195-4bb6-8158-eb3ff5c96ff9_9.jpg not downloaded yet
2025-12-04 10:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4e818afe-691b-4309-9d5c-6e489056b5f3_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4e818afe-691b-4309-9d5c-6e489056b5f3_5.jpg not downloaded yet
2025-12-04 10:08:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1564179-4007572-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001564179-01991001-001.pdf)
2025-12-04 10:08:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0bdf4d14-d195-4bb6-8158-eb3ff5c96ff9_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003622898-01985385-004.pdf)
2025-12-04 10:08:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0bdf4d14-d195-4bb6-8158-eb3ff5c96ff9_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003622898-01985385-004.pdf)
2025-12-04 10:08:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4e818afe-691b-4309-9d5c-6e489056b5f3_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000363011-01983801-002.pdf)
2025-12-04 10:08:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0bdf4d14-d195-4bb6-8158-eb3ff5c96ff9_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003622898-01985385-004.pdf)
2025-12-04 10:08:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0bdf4d14-d195-4bb6-8158-eb3ff5c96ff9_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003622898-01985385-004.pdf)
2025-12-04 10:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0bdf4d14-d195-4bb6-8158-eb3ff5c96ff9_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0bdf4d14-d195-4bb6-8158-eb3ff5c96ff9_ext_2.jpg not downloaded yet
2025-12-04 10:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4e818afe-691b-4309-9d5c-6e489056b5f3_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4e818afe-691b-4309-9d5c-6e489056b5f3_4.jpg not downloaded yet
2025-12-04 10:08:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1761741-4007528-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001761741-01991419-003.pdf)
2025-12-04 10:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0bdf4d14-d195-4bb6-8158-eb3ff5c96ff9_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0bdf4d14-d195-4bb6-8158-eb3ff5c96ff9_ext_5.jpg not downloaded yet
2025-12-04 10:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4e818afe-691b-4309-9d5c-6e489056b5f3_11.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4e818afe-691b-4309-9d5c-6e489056b5f3_11.jpg not downloaded yet
2025-12-04 10:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0bdf4d14-d195-4bb6-8158-eb3ff5c96ff9_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0bdf4d14-d195-4bb6-8158-eb3ff5c96ff9_ext_3.jpg not downloaded yet
2025-12-04 10:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4e818afe-691b-4309-9d5c-6e489056b5f3_10.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4e818afe-691b-4309-9d5c-6e489056b5f3_10.jpg not downloaded yet
2025-12-04 10:08:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc7e6910>
2025-12-04 10:08:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:08:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9200c31a-aec5-5dca-8036-0876fcfb70f2/9200c31a-aec5-5dca-8036-0876fcfb70f2_image_15.jpg HTTP/1.1" 201 0
2025-12-04 10:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1564179-4007572-1001.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1564179-4007572-1001.jpg saved to cache
2025-12-04 10:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 9200c31a-aec5-5dca-8036-0876fcfb70f2
2025-12-04 10:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0bdf4d14-d195-4bb6-8158-eb3ff5c96ff9_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0bdf4d14-d195-4bb6-8158-eb3ff5c96ff9_ext_4.jpg not downloaded yet
2025-12-04 10:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4e818afe-691b-4309-9d5c-6e489056b5f3_9.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4e818afe-691b-4309-9d5c-6e489056b5f3_9.jpg not downloaded yet
2025-12-04 10:08:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce64790>
2025-12-04 10:08:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:08:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9200c31a-aec5-5dca-8036-0876fcfb70f2/9200c31a-aec5-5dca-8036-0876fcfb70f2_image_14.jpg HTTP/1.1" 201 0
2025-12-04 10:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1564179-4007572-1000.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1564179-4007572-1000.jpg saved to cache
2025-12-04 10:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 9200c31a-aec5-5dca-8036-0876fcfb70f2
2025-12-04 10:08:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf9d210>
2025-12-04 10:08:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:08:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26ea40f5-de22-5022-b6fb-7b145e170b88/26ea40f5-de22-5022-b6fb-7b145e170b88_image_3.jpg HTTP/1.1" 201 0
2025-12-04 10:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0bdf4d14-d195-4bb6-8158-eb3ff5c96ff9_ext_1.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0bdf4d14-d195-4bb6-8158-eb3ff5c96ff9_ext_1.jpg saved to cache
2025-12-04 10:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 26ea40f5-de22-5022-b6fb-7b145e170b88
2025-12-04 10:08:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccfe0bd0>
2025-12-04 10:08:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:08:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26ea40f5-de22-5022-b6fb-7b145e170b88/26ea40f5-de22-5022-b6fb-7b145e170b88_image_4.jpg HTTP/1.1" 201 0
2025-12-04 10:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0bdf4d14-d195-4bb6-8158-eb3ff5c96ff9_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0bdf4d14-d195-4bb6-8158-eb3ff5c96ff9_5.jpg saved to cache
2025-12-04 10:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 26ea40f5-de22-5022-b6fb-7b145e170b88
2025-12-04 10:08:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc63e890>
2025-12-04 10:08:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:08:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ba9d830-17c9-5bf8-86a6-04450b3e9296/1ba9d830-17c9-5bf8-86a6-04450b3e9296_image_0.jpg HTTP/1.1" 201 0
2025-12-04 10:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4e818afe-691b-4309-9d5c-6e489056b5f3_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4e818afe-691b-4309-9d5c-6e489056b5f3_ext_7.jpg saved to cache
2025-12-04 10:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1ba9d830-17c9-5bf8-86a6-04450b3e9296
2025-12-04 10:08:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccffca50>
2025-12-04 10:08:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:08:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26ea40f5-de22-5022-b6fb-7b145e170b88/26ea40f5-de22-5022-b6fb-7b145e170b88_image_2.jpg HTTP/1.1" 201 0
2025-12-04 10:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0bdf4d14-d195-4bb6-8158-eb3ff5c96ff9_ext_6.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0bdf4d14-d195-4bb6-8158-eb3ff5c96ff9_ext_6.jpg saved to cache
2025-12-04 10:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 26ea40f5-de22-5022-b6fb-7b145e170b88
2025-12-04 10:08:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce76390>
2025-12-04 10:08:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:08:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26ea40f5-de22-5022-b6fb-7b145e170b88/26ea40f5-de22-5022-b6fb-7b145e170b88_image_1.jpg HTTP/1.1" 201 0
2025-12-04 10:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0bdf4d14-d195-4bb6-8158-eb3ff5c96ff9_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0bdf4d14-d195-4bb6-8158-eb3ff5c96ff9_ext_7.jpg saved to cache
2025-12-04 10:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 26ea40f5-de22-5022-b6fb-7b145e170b88
2025-12-04 10:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4e818afe-691b-4309-9d5c-6e489056b5f3_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000363011-01983801-002.pdf)
2025-12-04 10:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4e818afe-691b-4309-9d5c-6e489056b5f3_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000363011-01983801-002.pdf)
2025-12-04 10:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3622898-4004520-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3622898-4004520-13.jpg not downloaded yet
2025-12-04 10:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4e818afe-691b-4309-9d5c-6e489056b5f3_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4e818afe-691b-4309-9d5c-6e489056b5f3_ext_2.jpg not downloaded yet
2025-12-04 10:08:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd0c3390>
2025-12-04 10:08:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:08:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08d45d44-06c8-5777-ab82-d212449d4408/08d45d44-06c8-5777-ab82-d212449d4408_image_15.jpg HTTP/1.1" 201 0
2025-12-04 10:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1761741-4007528-1001.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1761741-4007528-1001.jpg saved to cache
2025-12-04 10:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 08d45d44-06c8-5777-ab82-d212449d4408
2025-12-04 10:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003630205-01980215-005.pdf> (referer: None)
2025-12-04 10:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0bdf4d14-d195-4bb6-8158-eb3ff5c96ff9_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003622898-01985385-004.pdf)
2025-12-04 10:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4e818afe-691b-4309-9d5c-6e489056b5f3_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000363011-01983801-002.pdf)
2025-12-04 10:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0bdf4d14-d195-4bb6-8158-eb3ff5c96ff9_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003622898-01985385-004.pdf)
2025-12-04 10:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0bdf4d14-d195-4bb6-8158-eb3ff5c96ff9_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003622898-01985385-004.pdf)
2025-12-04 10:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4e818afe-691b-4309-9d5c-6e489056b5f3_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000363011-01983801-002.pdf)
2025-12-04 10:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3622898-4004520-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3622898-4004520-1000.jpg not downloaded yet
2025-12-04 10:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4e818afe-691b-4309-9d5c-6e489056b5f3_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4e818afe-691b-4309-9d5c-6e489056b5f3_ext_5.jpg not downloaded yet
2025-12-04 10:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1761741-4007528-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001761741-01991419-003.pdf)
2025-12-04 10:08:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ce630390>
2025-12-04 10:08:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:08:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ba9d830-17c9-5bf8-86a6-04450b3e9296/1ba9d830-17c9-5bf8-86a6-04450b3e9296_image_3.jpg HTTP/1.1" 201 0
2025-12-04 10:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4e818afe-691b-4309-9d5c-6e489056b5f3_ext_1.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4e818afe-691b-4309-9d5c-6e489056b5f3_ext_1.jpg saved to cache
2025-12-04 10:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1ba9d830-17c9-5bf8-86a6-04450b3e9296
2025-12-04 10:08:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc58cb90>
2025-12-04 10:08:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:08:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ba9d830-17c9-5bf8-86a6-04450b3e9296/1ba9d830-17c9-5bf8-86a6-04450b3e9296_image_4.jpg HTTP/1.1" 201 0
2025-12-04 10:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4e818afe-691b-4309-9d5c-6e489056b5f3_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4e818afe-691b-4309-9d5c-6e489056b5f3_5.jpg saved to cache
2025-12-04 10:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1ba9d830-17c9-5bf8-86a6-04450b3e9296
2025-12-04 10:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3622898-4004520-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3622898-4004520-1001.jpg not downloaded yet
2025-12-04 10:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4e818afe-691b-4309-9d5c-6e489056b5f3_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4e818afe-691b-4309-9d5c-6e489056b5f3_ext_3.jpg not downloaded yet
2025-12-04 10:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3622898-4004520-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3622898-4004520-1002.jpg not downloaded yet
2025-12-04 10:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4e818afe-691b-4309-9d5c-6e489056b5f3_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4e818afe-691b-4309-9d5c-6e489056b5f3_ext_4.jpg not downloaded yet
2025-12-04 10:08:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc651b10>
2025-12-04 10:08:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:08:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acaf763c-39c3-5001-bfe8-4cff2ff87c31/acaf763c-39c3-5001-bfe8-4cff2ff87c31_expert_report_file_ac173280-ebfa-4bd2-ac12-31a3a5101acf.pdf HTTP/1.1" 201 0
2025-12-04 10:08:17 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item acaf763c-39c3-5001-bfe8-4cff2ff87c31
2025-12-04 10:08:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: acaf763c-39c3-5001-bfe8-4cff2ff87c31, skipping ID generation
2025-12-04 10:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item acaf763c-39c3-5001-bfe8-4cff2ff87c31
2025-12-04 10:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff232bf9e-f389-49a5-b917-f0cfbb98821c_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f232bf9e-f389-49a5-b917-f0cfbb98821c_ext_7.jpg not downloaded yet
2025-12-04 10:08:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce03fd0>
2025-12-04 10:08:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:08:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26ea40f5-de22-5022-b6fb-7b145e170b88/26ea40f5-de22-5022-b6fb-7b145e170b88_image_7.jpg HTTP/1.1" 201 0
2025-12-04 10:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0bdf4d14-d195-4bb6-8158-eb3ff5c96ff9_10.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0bdf4d14-d195-4bb6-8158-eb3ff5c96ff9_10.jpg saved to cache
2025-12-04 10:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 26ea40f5-de22-5022-b6fb-7b145e170b88
2025-12-04 10:08:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc68eb90>
2025-12-04 10:08:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:08:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ba9d830-17c9-5bf8-86a6-04450b3e9296/1ba9d830-17c9-5bf8-86a6-04450b3e9296_image_2.jpg HTTP/1.1" 201 0
2025-12-04 10:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4e818afe-691b-4309-9d5c-6e489056b5f3_ext_6.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4e818afe-691b-4309-9d5c-6e489056b5f3_ext_6.jpg saved to cache
2025-12-04 10:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1ba9d830-17c9-5bf8-86a6-04450b3e9296
2025-12-04 10:08:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccdea590>
2025-12-04 10:08:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:08:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26ea40f5-de22-5022-b6fb-7b145e170b88/26ea40f5-de22-5022-b6fb-7b145e170b88_image_8.jpg HTTP/1.1" 201 0
2025-12-04 10:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0bdf4d14-d195-4bb6-8158-eb3ff5c96ff9_9.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0bdf4d14-d195-4bb6-8158-eb3ff5c96ff9_9.jpg saved to cache
2025-12-04 10:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 26ea40f5-de22-5022-b6fb-7b145e170b88
2025-12-04 10:08:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd008c50>
2025-12-04 10:08:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:08:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26ea40f5-de22-5022-b6fb-7b145e170b88/26ea40f5-de22-5022-b6fb-7b145e170b88_image_6.jpg HTTP/1.1" 201 0
2025-12-04 10:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0bdf4d14-d195-4bb6-8158-eb3ff5c96ff9_11.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0bdf4d14-d195-4bb6-8158-eb3ff5c96ff9_11.jpg saved to cache
2025-12-04 10:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 26ea40f5-de22-5022-b6fb-7b145e170b88
2025-12-04 10:08:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd0f5cd0>
2025-12-04 10:08:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 10:08:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ba9d830-17c9-5bf8-86a6-04450b3e9296/1ba9d830-17c9-5bf8-86a6-04450b3e9296_image_1.jpg HTTP/1.1" 201 0
2025-12-04 10:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4e818afe-691b-4309-9d5c-6e489056b5f3_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4e818afe-691b-4309-9d5c-6e489056b5f3_ext_7.jpg saved to cache
2025-12-04 10:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1ba9d830-17c9-5bf8-86a6-04450b3e9296
2025-12-04 10:08:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd0f5cd0>
2025-12-04 10:08:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:08:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08d45d44-06c8-5777-ab82-d212449d4408/08d45d44-06c8-5777-ab82-d212449d4408_image_14.jpg HTTP/1.1" 201 0
2025-12-04 10:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1761741-4007528-1000.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1761741-4007528-1000.jpg saved to cache
2025-12-04 10:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 08d45d44-06c8-5777-ab82-d212449d4408
2025-12-04 10:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4e818afe-691b-4309-9d5c-6e489056b5f3_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000363011-01983801-002.pdf)
2025-12-04 10:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3622898-4004520-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3622898-4004520-1003.jpg not downloaded yet
2025-12-04 10:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-363011-4004907-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-363011-4004907-13.jpg not downloaded yet
2025-12-04 10:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff232bf9e-f389-49a5-b917-f0cfbb98821c_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f232bf9e-f389-49a5-b917-f0cfbb98821c_ext_7.jpg not downloaded yet
2025-12-04 10:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3622898-4004520-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3622898-4004520-1004.jpg not downloaded yet
2025-12-04 10:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-363011-4004907-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-363011-4004907-1000.jpg not downloaded yet
2025-12-04 10:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff232bf9e-f389-49a5-b917-f0cfbb98821c_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f232bf9e-f389-49a5-b917-f0cfbb98821c_ext_6.jpg not downloaded yet
2025-12-04 10:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003655657-01966143-004.pdf> (referer: None)
2025-12-04 10:08:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5aae10>
2025-12-04 10:08:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:08:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ba9d830-17c9-5bf8-86a6-04450b3e9296/1ba9d830-17c9-5bf8-86a6-04450b3e9296_image_5.jpg HTTP/1.1" 201 0
2025-12-04 10:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4e818afe-691b-4309-9d5c-6e489056b5f3_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4e818afe-691b-4309-9d5c-6e489056b5f3_4.jpg saved to cache
2025-12-04 10:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1ba9d830-17c9-5bf8-86a6-04450b3e9296
2025-12-04 10:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3622898-4004520-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3622898-4004520-1005.jpg not downloaded yet
2025-12-04 10:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-363011-4004907-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-363011-4004907-1001.jpg not downloaded yet
2025-12-04 10:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff232bf9e-f389-49a5-b917-f0cfbb98821c_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f232bf9e-f389-49a5-b917-f0cfbb98821c_ext_1.jpg not downloaded yet
2025-12-04 10:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-363011-4004907-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-363011-4004907-1002.jpg not downloaded yet
2025-12-04 10:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff232bf9e-f389-49a5-b917-f0cfbb98821c_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f232bf9e-f389-49a5-b917-f0cfbb98821c_5.jpg not downloaded yet
2025-12-04 10:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-363011-4004907-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-363011-4004907-1003.jpg not downloaded yet
2025-12-04 10:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff232bf9e-f389-49a5-b917-f0cfbb98821c_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f232bf9e-f389-49a5-b917-f0cfbb98821c_4.jpg not downloaded yet
2025-12-04 10:08:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ce7f8650>
2025-12-04 10:08:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:08:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5edeafc5-e046-59de-ab0b-202840dea4e9/5edeafc5-e046-59de-ab0b-202840dea4e9_expert_report_file_d802b1ef-24b9-41c8-b769-aebbb2a79ab3.pdf HTTP/1.1" 201 0
2025-12-04 10:08:20 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 5edeafc5-e046-59de-ab0b-202840dea4e9
2025-12-04 10:08:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5edeafc5-e046-59de-ab0b-202840dea4e9, skipping ID generation
2025-12-04 10:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 5edeafc5-e046-59de-ab0b-202840dea4e9
2025-12-04 10:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9a29c1b9-b45c-413e-9492-e704436a0e6c_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9a29c1b9-b45c-413e-9492-e704436a0e6c_ext_7.jpg already downloaded
2025-12-04 10:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9a29c1b9-b45c-413e-9492-e704436a0e6c_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9a29c1b9-b45c-413e-9492-e704436a0e6c_ext_7.jpg already downloaded
2025-12-04 10:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9a29c1b9-b45c-413e-9492-e704436a0e6c_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9a29c1b9-b45c-413e-9492-e704436a0e6c_ext_6.jpg already downloaded
2025-12-04 10:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9a29c1b9-b45c-413e-9492-e704436a0e6c_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9a29c1b9-b45c-413e-9492-e704436a0e6c_ext_1.jpg already downloaded
2025-12-04 10:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9a29c1b9-b45c-413e-9492-e704436a0e6c_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9a29c1b9-b45c-413e-9492-e704436a0e6c_5.jpg already downloaded
2025-12-04 10:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9a29c1b9-b45c-413e-9492-e704436a0e6c_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9a29c1b9-b45c-413e-9492-e704436a0e6c_4.jpg already downloaded
2025-12-04 10:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9a29c1b9-b45c-413e-9492-e704436a0e6c_11.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9a29c1b9-b45c-413e-9492-e704436a0e6c_11.jpg already downloaded
2025-12-04 10:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9a29c1b9-b45c-413e-9492-e704436a0e6c_10.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9a29c1b9-b45c-413e-9492-e704436a0e6c_10.jpg already downloaded
2025-12-04 10:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9a29c1b9-b45c-413e-9492-e704436a0e6c_9.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9a29c1b9-b45c-413e-9492-e704436a0e6c_9.jpg already downloaded
2025-12-04 10:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9a29c1b9-b45c-413e-9492-e704436a0e6c_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9a29c1b9-b45c-413e-9492-e704436a0e6c_ext_2.jpg already downloaded
2025-12-04 10:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9a29c1b9-b45c-413e-9492-e704436a0e6c_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9a29c1b9-b45c-413e-9492-e704436a0e6c_ext_5.jpg already downloaded
2025-12-04 10:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9a29c1b9-b45c-413e-9492-e704436a0e6c_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9a29c1b9-b45c-413e-9492-e704436a0e6c_ext_3.jpg already downloaded
2025-12-04 10:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9a29c1b9-b45c-413e-9492-e704436a0e6c_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9a29c1b9-b45c-413e-9492-e704436a0e6c_ext_4.jpg already downloaded
2025-12-04 10:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3655657-3976958-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3655657-3976958-13.jpg already downloaded
2025-12-04 10:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3655657-3976958-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3655657-3976958-1000.jpg already downloaded
2025-12-04 10:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3655657-3976958-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3655657-3976958-1001.jpg already downloaded
2025-12-04 10:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3655657-3976958-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3655657-3976958-1002.jpg already downloaded
2025-12-04 10:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3655657-3976958-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3655657-3976958-1003.jpg already downloaded
2025-12-04 10:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3655657-3976958-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3655657-3976958-1004.jpg already downloaded
2025-12-04 10:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3655657-3976958-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3655657-3976958-1005.jpg already downloaded
2025-12-04 10:08:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 5edeafc5-e046-59de-ab0b-202840dea4e9, identifier: 3655657
2025-12-04 10:08:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 5edeafc5-e046-59de-ab0b-202840dea4e9 with identifier: 3655657
2025-12-04 10:08:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 5edeafc5-e046-59de-ab0b-202840dea4e9 with identifier: 3655657
2025-12-04 10:08:21 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 5edeafc5-e046-59de-ab0b-202840dea4e9 with identifier: 3655657 to the API
2025-12-04 10:08:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 10:08:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 10:08:22 [scrapy.core.scraper] DEBUG: Scraped from <200 http://ecr.manheim.co.uk/pdf/MOL-0003655657-01966143-004.pdf>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5edeafc5-e046-59de-ab0b-202840dea4e9/5edeafc5-e046-59de-ab0b-202840dea4e9_expert_report_file_d802b1ef-24b9-41c8-b769-aebbb2a79ab3.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003655657-01966143-004.pdf',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '1.0L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '5edeafc5-e046-59de-ab0b-202840dea4e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'ET21HVA',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/POLO?id=3655657',
 'listing': 'auction',
 'location': 'Birmingham',
 'make': 'VOLKSWAGEN',
 'model': 'POLO',
 'odometer': 17976,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 34,
 'photo_urls': ['http://images.manheim.co.uk/images/units/zoom/9a29c1b9-b45c-413e-9492-e704436a0e6c_ext_7.jpg',
                'http://images.manheim.co.uk/images/units/zoom/9a29c1b9-b45c-413e-9492-e704436a0e6c_ext_7.jpg',
                'http://images.manheim.co.uk/images/units/zoom/9a29c1b9-b45c-413e-9492-e704436a0e6c_ext_6.jpg',
                'http://images.manheim.co.uk/images/units/zoom/9a29c1b9-b45c-413e-9492-e704436a0e6c_ext_1.jpg',
                'http://images.manheim.co.uk/images/units/zoom/9a29c1b9-b45c-413e-9492-e704436a0e6c_5.jpg',
                'http://images.manheim.co.uk/images/units/zoom/9a29c1b9-b45c-413e-9492-e704436a0e6c_4.jpg',
                'http://images.manheim.co.uk/images/units/zoom/9a29c1b9-b45c-413e-9492-e704436a0e6c_11.jpg',
                'http://images.manheim.co.uk/images/units/zoom/9a29c1b9-b45c-413e-9492-e704436a0e6c_10.jpg',
                'http://images.manheim.co.uk/images/units/zoom/9a29c1b9-b45c-413e-9492-e704436a0e6c_9.jpg',
                'http://images.manheim.co.uk/images/units/zoom/9a29c1b9-b45c-413e-9492-e704436a0e6c_ext_2.jpg',
                'http://images.manheim.co.uk/images/units/zoom/9a29c1b9-b45c-413e-9492-e704436a0e6c_ext_5.jpg',
                'http://images.manheim.co.uk/images/units/zoom/9a29c1b9-b45c-413e-9492-e704436a0e6c_ext_3.jpg',
                'http://images.manheim.co.uk/images/units/zoom/9a29c1b9-b45c-413e-9492-e704436a0e6c_ext_4.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3655657-3976958-13.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3655657-3976958-1000.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3655657-3976958-1001.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3655657-3976958-1002.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3655657-3976958-1003.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3655657-3976958-1004.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3655657-3976958-1005.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5edeafc5-e046-59de-ab0b-202840dea4e9/5edeafc5-e046-59de-ab0b-202840dea4e9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 195699,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9a29c1b9-b45c-413e-9492-e704436a0e6c_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5edeafc5-e046-59de-ab0b-202840dea4e9/5edeafc5-e046-59de-ab0b-202840dea4e9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 195699,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9a29c1b9-b45c-413e-9492-e704436a0e6c_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5edeafc5-e046-59de-ab0b-202840dea4e9/5edeafc5-e046-59de-ab0b-202840dea4e9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 164900,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9a29c1b9-b45c-413e-9492-e704436a0e6c_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5edeafc5-e046-59de-ab0b-202840dea4e9/5edeafc5-e046-59de-ab0b-202840dea4e9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 181609,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9a29c1b9-b45c-413e-9492-e704436a0e6c_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5edeafc5-e046-59de-ab0b-202840dea4e9/5edeafc5-e046-59de-ab0b-202840dea4e9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 191966,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9a29c1b9-b45c-413e-9492-e704436a0e6c_5.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5edeafc5-e046-59de-ab0b-202840dea4e9/5edeafc5-e046-59de-ab0b-202840dea4e9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 197134,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9a29c1b9-b45c-413e-9492-e704436a0e6c_4.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5edeafc5-e046-59de-ab0b-202840dea4e9/5edeafc5-e046-59de-ab0b-202840dea4e9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 184869,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9a29c1b9-b45c-413e-9492-e704436a0e6c_11.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5edeafc5-e046-59de-ab0b-202840dea4e9/5edeafc5-e046-59de-ab0b-202840dea4e9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 190574,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9a29c1b9-b45c-413e-9492-e704436a0e6c_10.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5edeafc5-e046-59de-ab0b-202840dea4e9/5edeafc5-e046-59de-ab0b-202840dea4e9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 203055,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9a29c1b9-b45c-413e-9492-e704436a0e6c_9.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5edeafc5-e046-59de-ab0b-202840dea4e9/5edeafc5-e046-59de-ab0b-202840dea4e9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 187745,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9a29c1b9-b45c-413e-9492-e704436a0e6c_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5edeafc5-e046-59de-ab0b-202840dea4e9/5edeafc5-e046-59de-ab0b-202840dea4e9_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 162589,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9a29c1b9-b45c-413e-9492-e704436a0e6c_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5edeafc5-e046-59de-ab0b-202840dea4e9/5edeafc5-e046-59de-ab0b-202840dea4e9_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 177274,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9a29c1b9-b45c-413e-9492-e704436a0e6c_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5edeafc5-e046-59de-ab0b-202840dea4e9/5edeafc5-e046-59de-ab0b-202840dea4e9_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 234250,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9a29c1b9-b45c-413e-9492-e704436a0e6c_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5edeafc5-e046-59de-ab0b-202840dea4e9/5edeafc5-e046-59de-ab0b-202840dea4e9_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 304084,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3655657-3976958-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5edeafc5-e046-59de-ab0b-202840dea4e9/5edeafc5-e046-59de-ab0b-202840dea4e9_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 360462,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3655657-3976958-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5edeafc5-e046-59de-ab0b-202840dea4e9/5edeafc5-e046-59de-ab0b-202840dea4e9_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 258608,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3655657-3976958-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5edeafc5-e046-59de-ab0b-202840dea4e9/5edeafc5-e046-59de-ab0b-202840dea4e9_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 264600,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3655657-3976958-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5edeafc5-e046-59de-ab0b-202840dea4e9/5edeafc5-e046-59de-ab0b-202840dea4e9_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 372583,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3655657-3976958-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5edeafc5-e046-59de-ab0b-202840dea4e9/5edeafc5-e046-59de-ab0b-202840dea4e9_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 359910,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3655657-3976958-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5edeafc5-e046-59de-ab0b-202840dea4e9/5edeafc5-e046-59de-ab0b-202840dea4e9_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 328789,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3655657-3976958-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-06',
 'seller_name': 'Hilton Garage Ltd',
 'title': 'VOLKSWAGEN POLO 1.0 TSI 95 Match 5dr',
 'transmission': 'manual',
 'trim': '1.0 TSI 95 Match 5dr',
 'year': 2021}
2025-12-04 10:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273655657%27 HTTP/1.1" 200 None
2025-12-04 10:08:22 [manheim.gb] INFO: Saving data for 3655657: {'created_time': 1764842902.889643, 'last_price_update_time': 1764842902.889655, 'auction_closing_time': 1765184400.0}
2025-12-04 10:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3655657') HTTP/1.1" 204 0
2025-12-04 10:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-363011-4004907-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-363011-4004907-1004.jpg not downloaded yet
2025-12-04 10:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff232bf9e-f389-49a5-b917-f0cfbb98821c_11.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f232bf9e-f389-49a5-b917-f0cfbb98821c_11.jpg not downloaded yet
2025-12-04 10:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-363011-4004907-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-363011-4004907-1005.jpg not downloaded yet
2025-12-04 10:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff232bf9e-f389-49a5-b917-f0cfbb98821c_10.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f232bf9e-f389-49a5-b917-f0cfbb98821c_10.jpg not downloaded yet
2025-12-04 10:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff232bf9e-f389-49a5-b917-f0cfbb98821c_9.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f232bf9e-f389-49a5-b917-f0cfbb98821c_9.jpg not downloaded yet
2025-12-04 10:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff232bf9e-f389-49a5-b917-f0cfbb98821c_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f232bf9e-f389-49a5-b917-f0cfbb98821c_ext_2.jpg not downloaded yet
2025-12-04 10:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff232bf9e-f389-49a5-b917-f0cfbb98821c_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f232bf9e-f389-49a5-b917-f0cfbb98821c_ext_5.jpg not downloaded yet
2025-12-04 10:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff232bf9e-f389-49a5-b917-f0cfbb98821c_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f232bf9e-f389-49a5-b917-f0cfbb98821c_ext_3.jpg not downloaded yet
2025-12-04 10:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff232bf9e-f389-49a5-b917-f0cfbb98821c_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f232bf9e-f389-49a5-b917-f0cfbb98821c_ext_4.jpg not downloaded yet
2025-12-04 10:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3630205-3998328-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3630205-3998328-13.jpg not downloaded yet
2025-12-04 10:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3630205-3998328-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3630205-3998328-1000.jpg not downloaded yet
2025-12-04 10:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3630205-3998328-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3630205-3998328-1001.jpg not downloaded yet
2025-12-04 10:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3630205-3998328-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3630205-3998328-1002.jpg not downloaded yet
2025-12-04 10:08:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003613252-01984866-002.pdf> (referer: None)
2025-12-04 10:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3630205-3998328-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3630205-3998328-1003.jpg not downloaded yet
2025-12-04 10:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3630205-3998328-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3630205-3998328-1004.jpg not downloaded yet
2025-12-04 10:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3630205-3998328-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3630205-3998328-1005.jpg not downloaded yet
2025-12-04 10:08:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-363011-4004907-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000363011-01983801-002.pdf)
2025-12-04 10:08:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc725a50>
2025-12-04 10:08:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:08:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8be1cec-e312-503e-a3eb-d5705c7c2660/d8be1cec-e312-503e-a3eb-d5705c7c2660_expert_report_file_59f56910-e401-469f-88fe-6565d5a47692.pdf HTTP/1.1" 201 0
2025-12-04 10:08:23 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item d8be1cec-e312-503e-a3eb-d5705c7c2660
2025-12-04 10:08:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d8be1cec-e312-503e-a3eb-d5705c7c2660, skipping ID generation
2025-12-04 10:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item d8be1cec-e312-503e-a3eb-d5705c7c2660
2025-12-04 10:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa05c29cf-ac73-477c-941f-af2d8357f2b8_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a05c29cf-ac73-477c-941f-af2d8357f2b8_ext_7.jpg not downloaded yet
2025-12-04 10:08:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-363011-4004907-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000363011-01983801-002.pdf)
2025-12-04 10:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa05c29cf-ac73-477c-941f-af2d8357f2b8_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a05c29cf-ac73-477c-941f-af2d8357f2b8_ext_7.jpg not downloaded yet
2025-12-04 10:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa05c29cf-ac73-477c-941f-af2d8357f2b8_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a05c29cf-ac73-477c-941f-af2d8357f2b8_ext_6.jpg not downloaded yet
2025-12-04 10:08:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f232bf9e-f389-49a5-b917-f0cfbb98821c_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003630205-01980215-005.pdf)
2025-12-04 10:08:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f232bf9e-f389-49a5-b917-f0cfbb98821c_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003630205-01980215-005.pdf)
2025-12-04 10:08:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f232bf9e-f389-49a5-b917-f0cfbb98821c_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003630205-01980215-005.pdf)
2025-12-04 10:08:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f232bf9e-f389-49a5-b917-f0cfbb98821c_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003630205-01980215-005.pdf)
2025-12-04 10:08:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd0d8250>
2025-12-04 10:08:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:08:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ba9d830-17c9-5bf8-86a6-04450b3e9296/1ba9d830-17c9-5bf8-86a6-04450b3e9296_image_18.jpg HTTP/1.1" 201 0
2025-12-04 10:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-363011-4004907-1004.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-363011-4004907-1004.jpg saved to cache
2025-12-04 10:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 1ba9d830-17c9-5bf8-86a6-04450b3e9296
2025-12-04 10:08:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-363011-4004907-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000363011-01983801-002.pdf)
2025-12-04 10:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa05c29cf-ac73-477c-941f-af2d8357f2b8_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a05c29cf-ac73-477c-941f-af2d8357f2b8_ext_1.jpg not downloaded yet
2025-12-04 10:08:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-363011-4004907-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000363011-01983801-002.pdf)
2025-12-04 10:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa05c29cf-ac73-477c-941f-af2d8357f2b8_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a05c29cf-ac73-477c-941f-af2d8357f2b8_5.jpg not downloaded yet
2025-12-04 10:08:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f232bf9e-f389-49a5-b917-f0cfbb98821c_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003630205-01980215-005.pdf)
2025-12-04 10:08:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-363011-4004907-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000363011-01983801-002.pdf)
2025-12-04 10:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa05c29cf-ac73-477c-941f-af2d8357f2b8_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a05c29cf-ac73-477c-941f-af2d8357f2b8_4.jpg not downloaded yet
2025-12-04 10:08:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc7e6dd0>
2025-12-04 10:08:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:08:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ba9d830-17c9-5bf8-86a6-04450b3e9296/1ba9d830-17c9-5bf8-86a6-04450b3e9296_image_16.jpg HTTP/1.1" 201 0
2025-12-04 10:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-363011-4004907-1002.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-363011-4004907-1002.jpg saved to cache
2025-12-04 10:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 1ba9d830-17c9-5bf8-86a6-04450b3e9296
2025-12-04 10:08:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf5b5d0>
2025-12-04 10:08:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:08:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acaf763c-39c3-5001-bfe8-4cff2ff87c31/acaf763c-39c3-5001-bfe8-4cff2ff87c31_image_5.jpg HTTP/1.1" 201 0
2025-12-04 10:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff232bf9e-f389-49a5-b917-f0cfbb98821c_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f232bf9e-f389-49a5-b917-f0cfbb98821c_4.jpg saved to cache
2025-12-04 10:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item acaf763c-39c3-5001-bfe8-4cff2ff87c31
2025-12-04 10:08:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6cf810>
2025-12-04 10:08:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:08:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acaf763c-39c3-5001-bfe8-4cff2ff87c31/acaf763c-39c3-5001-bfe8-4cff2ff87c31_image_6.jpg HTTP/1.1" 201 0
2025-12-04 10:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff232bf9e-f389-49a5-b917-f0cfbb98821c_11.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f232bf9e-f389-49a5-b917-f0cfbb98821c_11.jpg saved to cache
2025-12-04 10:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item acaf763c-39c3-5001-bfe8-4cff2ff87c31
2025-12-04 10:08:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc7e7050>
2025-12-04 10:08:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 10:08:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acaf763c-39c3-5001-bfe8-4cff2ff87c31/acaf763c-39c3-5001-bfe8-4cff2ff87c31_image_7.jpg HTTP/1.1" 201 0
2025-12-04 10:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff232bf9e-f389-49a5-b917-f0cfbb98821c_10.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f232bf9e-f389-49a5-b917-f0cfbb98821c_10.jpg saved to cache
2025-12-04 10:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item acaf763c-39c3-5001-bfe8-4cff2ff87c31
2025-12-04 10:08:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6ce1d0>
2025-12-04 10:08:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:08:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acaf763c-39c3-5001-bfe8-4cff2ff87c31/acaf763c-39c3-5001-bfe8-4cff2ff87c31_image_4.jpg HTTP/1.1" 201 0
2025-12-04 10:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff232bf9e-f389-49a5-b917-f0cfbb98821c_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f232bf9e-f389-49a5-b917-f0cfbb98821c_5.jpg saved to cache
2025-12-04 10:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item acaf763c-39c3-5001-bfe8-4cff2ff87c31
2025-12-04 10:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa05c29cf-ac73-477c-941f-af2d8357f2b8_11.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a05c29cf-ac73-477c-941f-af2d8357f2b8_11.jpg not downloaded yet
2025-12-04 10:08:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccced510>
2025-12-04 10:08:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:08:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ba9d830-17c9-5bf8-86a6-04450b3e9296/1ba9d830-17c9-5bf8-86a6-04450b3e9296_image_19.jpg HTTP/1.1" 201 0
2025-12-04 10:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-363011-4004907-1005.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-363011-4004907-1005.jpg saved to cache
2025-12-04 10:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 1ba9d830-17c9-5bf8-86a6-04450b3e9296
2025-12-04 10:08:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf83490>
2025-12-04 10:08:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:08:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ba9d830-17c9-5bf8-86a6-04450b3e9296/1ba9d830-17c9-5bf8-86a6-04450b3e9296_image_17.jpg HTTP/1.1" 201 0
2025-12-04 10:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-363011-4004907-1003.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-363011-4004907-1003.jpg saved to cache
2025-12-04 10:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 1ba9d830-17c9-5bf8-86a6-04450b3e9296
2025-12-04 10:08:26 [scrapy.extensions.logstats] INFO: Crawled 143 pages (at 19 pages/min), scraped 39 items (at 8 items/min)
2025-12-04 10:08:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3622898-4004520-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003622898-01985385-004.pdf)
2025-12-04 10:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa05c29cf-ac73-477c-941f-af2d8357f2b8_10.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a05c29cf-ac73-477c-941f-af2d8357f2b8_10.jpg not downloaded yet
2025-12-04 10:08:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce75710>
2025-12-04 10:08:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:08:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acaf763c-39c3-5001-bfe8-4cff2ff87c31/acaf763c-39c3-5001-bfe8-4cff2ff87c31_image_3.jpg HTTP/1.1" 201 0
2025-12-04 10:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff232bf9e-f389-49a5-b917-f0cfbb98821c_ext_1.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f232bf9e-f389-49a5-b917-f0cfbb98821c_ext_1.jpg saved to cache
2025-12-04 10:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item acaf763c-39c3-5001-bfe8-4cff2ff87c31
2025-12-04 10:08:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc573fd0>
2025-12-04 10:08:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:08:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ba9d830-17c9-5bf8-86a6-04450b3e9296/1ba9d830-17c9-5bf8-86a6-04450b3e9296_image_15.jpg HTTP/1.1" 201 0
2025-12-04 10:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-363011-4004907-1001.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-363011-4004907-1001.jpg saved to cache
2025-12-04 10:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 1ba9d830-17c9-5bf8-86a6-04450b3e9296
2025-12-04 10:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa05c29cf-ac73-477c-941f-af2d8357f2b8_9.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a05c29cf-ac73-477c-941f-af2d8357f2b8_9.jpg not downloaded yet
2025-12-04 10:08:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd820d0>
2025-12-04 10:08:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:08:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26ea40f5-de22-5022-b6fb-7b145e170b88/26ea40f5-de22-5022-b6fb-7b145e170b88_image_19.jpg HTTP/1.1" 201 0
2025-12-04 10:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3622898-4004520-1005.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3622898-4004520-1005.jpg saved to cache
2025-12-04 10:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 26ea40f5-de22-5022-b6fb-7b145e170b88
2025-12-04 10:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa05c29cf-ac73-477c-941f-af2d8357f2b8_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a05c29cf-ac73-477c-941f-af2d8357f2b8_ext_2.jpg not downloaded yet
2025-12-04 10:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa05c29cf-ac73-477c-941f-af2d8357f2b8_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a05c29cf-ac73-477c-941f-af2d8357f2b8_ext_5.jpg not downloaded yet
2025-12-04 10:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa05c29cf-ac73-477c-941f-af2d8357f2b8_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a05c29cf-ac73-477c-941f-af2d8357f2b8_ext_3.jpg not downloaded yet
2025-12-04 10:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa05c29cf-ac73-477c-941f-af2d8357f2b8_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a05c29cf-ac73-477c-941f-af2d8357f2b8_ext_4.jpg not downloaded yet
2025-12-04 10:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3613252-4000724-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3613252-4000724-13.jpg not downloaded yet
2025-12-04 10:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3613252-4000724-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3613252-4000724-1000.jpg not downloaded yet
2025-12-04 10:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3613252-4000724-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3613252-4000724-1001.jpg not downloaded yet
2025-12-04 10:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3613252-4000724-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3613252-4000724-1002.jpg not downloaded yet
2025-12-04 10:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3613252-4000724-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3613252-4000724-1003.jpg not downloaded yet
2025-12-04 10:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3613252-4000724-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3613252-4000724-1004.jpg not downloaded yet
2025-12-04 10:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3613252-4000724-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3613252-4000724-1005.jpg not downloaded yet
2025-12-04 10:08:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3613252-4000724-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003613252-01984866-002.pdf)
2025-12-04 10:08:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a05c29cf-ac73-477c-941f-af2d8357f2b8_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003613252-01984866-002.pdf)
2025-12-04 10:08:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3613252-4000724-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003613252-01984866-002.pdf)
2025-12-04 10:08:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3613252-4000724-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003613252-01984866-002.pdf)
2025-12-04 10:08:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccc5e490>
2025-12-04 10:08:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:08:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8be1cec-e312-503e-a3eb-d5705c7c2660/d8be1cec-e312-503e-a3eb-d5705c7c2660_image_13.jpg HTTP/1.1" 201 0
2025-12-04 10:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3613252-4000724-13.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3613252-4000724-13.jpg saved to cache
2025-12-04 10:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item d8be1cec-e312-503e-a3eb-d5705c7c2660
2025-12-04 10:08:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3613252-4000724-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003613252-01984866-002.pdf)
2025-12-04 10:08:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a05c29cf-ac73-477c-941f-af2d8357f2b8_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003613252-01984866-002.pdf)
2025-12-04 10:08:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a05c29cf-ac73-477c-941f-af2d8357f2b8_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003613252-01984866-002.pdf)
2025-12-04 10:08:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a05c29cf-ac73-477c-941f-af2d8357f2b8_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003613252-01984866-002.pdf)
2025-12-04 10:08:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce09050>
2025-12-04 10:08:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:08:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8be1cec-e312-503e-a3eb-d5705c7c2660/d8be1cec-e312-503e-a3eb-d5705c7c2660_image_12.jpg HTTP/1.1" 201 0
2025-12-04 10:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa05c29cf-ac73-477c-941f-af2d8357f2b8_ext_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a05c29cf-ac73-477c-941f-af2d8357f2b8_ext_4.jpg saved to cache
2025-12-04 10:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item d8be1cec-e312-503e-a3eb-d5705c7c2660
2025-12-04 10:08:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce534d0>
2025-12-04 10:08:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:08:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8be1cec-e312-503e-a3eb-d5705c7c2660/d8be1cec-e312-503e-a3eb-d5705c7c2660_image_14.jpg HTTP/1.1" 201 0
2025-12-04 10:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3613252-4000724-1000.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3613252-4000724-1000.jpg saved to cache
2025-12-04 10:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item d8be1cec-e312-503e-a3eb-d5705c7c2660
2025-12-04 10:08:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5cd890>
2025-12-04 10:08:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:08:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8be1cec-e312-503e-a3eb-d5705c7c2660/d8be1cec-e312-503e-a3eb-d5705c7c2660_image_18.jpg HTTP/1.1" 201 0
2025-12-04 10:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3613252-4000724-1004.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3613252-4000724-1004.jpg saved to cache
2025-12-04 10:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item d8be1cec-e312-503e-a3eb-d5705c7c2660
2025-12-04 10:08:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3613252-4000724-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003613252-01984866-002.pdf)
2025-12-04 10:08:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3613252-4000724-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003613252-01984866-002.pdf)
2025-12-04 10:08:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3613252-4000724-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003613252-01984866-002.pdf)
2025-12-04 10:08:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc612410>
2025-12-04 10:08:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:08:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8be1cec-e312-503e-a3eb-d5705c7c2660/d8be1cec-e312-503e-a3eb-d5705c7c2660_image_19.jpg HTTP/1.1" 201 0
2025-12-04 10:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3613252-4000724-1005.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3613252-4000724-1005.jpg saved to cache
2025-12-04 10:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item d8be1cec-e312-503e-a3eb-d5705c7c2660
2025-12-04 10:08:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc72f790>
2025-12-04 10:08:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:08:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8be1cec-e312-503e-a3eb-d5705c7c2660/d8be1cec-e312-503e-a3eb-d5705c7c2660_image_10.jpg HTTP/1.1" 201 0
2025-12-04 10:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa05c29cf-ac73-477c-941f-af2d8357f2b8_ext_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a05c29cf-ac73-477c-941f-af2d8357f2b8_ext_5.jpg saved to cache
2025-12-04 10:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item d8be1cec-e312-503e-a3eb-d5705c7c2660
2025-12-04 10:08:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5a1e90>
2025-12-04 10:08:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:08:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8be1cec-e312-503e-a3eb-d5705c7c2660/d8be1cec-e312-503e-a3eb-d5705c7c2660_image_11.jpg HTTP/1.1" 201 0
2025-12-04 10:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa05c29cf-ac73-477c-941f-af2d8357f2b8_ext_3.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a05c29cf-ac73-477c-941f-af2d8357f2b8_ext_3.jpg saved to cache
2025-12-04 10:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item d8be1cec-e312-503e-a3eb-d5705c7c2660
2025-12-04 10:08:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5a2610>
2025-12-04 10:08:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:08:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8be1cec-e312-503e-a3eb-d5705c7c2660/d8be1cec-e312-503e-a3eb-d5705c7c2660_image_8.jpg HTTP/1.1" 201 0
2025-12-04 10:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa05c29cf-ac73-477c-941f-af2d8357f2b8_9.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a05c29cf-ac73-477c-941f-af2d8357f2b8_9.jpg saved to cache
2025-12-04 10:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d8be1cec-e312-503e-a3eb-d5705c7c2660
2025-12-04 10:08:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a05c29cf-ac73-477c-941f-af2d8357f2b8_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003613252-01984866-002.pdf)
2025-12-04 10:08:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a05c29cf-ac73-477c-941f-af2d8357f2b8_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003613252-01984866-002.pdf)
2025-12-04 10:08:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a05c29cf-ac73-477c-941f-af2d8357f2b8_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003613252-01984866-002.pdf)
2025-12-04 10:08:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a05c29cf-ac73-477c-941f-af2d8357f2b8_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003613252-01984866-002.pdf)
2025-12-04 10:08:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a05c29cf-ac73-477c-941f-af2d8357f2b8_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003613252-01984866-002.pdf)
2025-12-04 10:08:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a05c29cf-ac73-477c-941f-af2d8357f2b8_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003613252-01984866-002.pdf)
2025-12-04 10:08:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a05c29cf-ac73-477c-941f-af2d8357f2b8_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003613252-01984866-002.pdf)
2025-12-04 10:08:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a05c29cf-ac73-477c-941f-af2d8357f2b8_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003613252-01984866-002.pdf)
2025-12-04 10:08:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd11fa90>
2025-12-04 10:08:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:08:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8be1cec-e312-503e-a3eb-d5705c7c2660/d8be1cec-e312-503e-a3eb-d5705c7c2660_image_15.jpg HTTP/1.1" 201 0
2025-12-04 10:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3613252-4000724-1001.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3613252-4000724-1001.jpg saved to cache
2025-12-04 10:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item d8be1cec-e312-503e-a3eb-d5705c7c2660
2025-12-04 10:08:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cccd0f50>
2025-12-04 10:08:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:08:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8be1cec-e312-503e-a3eb-d5705c7c2660/d8be1cec-e312-503e-a3eb-d5705c7c2660_image_16.jpg HTTP/1.1" 201 0
2025-12-04 10:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3613252-4000724-1002.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3613252-4000724-1002.jpg saved to cache
2025-12-04 10:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item d8be1cec-e312-503e-a3eb-d5705c7c2660
2025-12-04 10:08:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cccd2250>
2025-12-04 10:08:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:08:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8be1cec-e312-503e-a3eb-d5705c7c2660/d8be1cec-e312-503e-a3eb-d5705c7c2660_image_17.jpg HTTP/1.1" 201 0
2025-12-04 10:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3613252-4000724-1003.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3613252-4000724-1003.jpg saved to cache
2025-12-04 10:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item d8be1cec-e312-503e-a3eb-d5705c7c2660
2025-12-04 10:08:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccc4bb10>
2025-12-04 10:08:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:08:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8be1cec-e312-503e-a3eb-d5705c7c2660/d8be1cec-e312-503e-a3eb-d5705c7c2660_image_9.jpg HTTP/1.1" 201 0
2025-12-04 10:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa05c29cf-ac73-477c-941f-af2d8357f2b8_ext_2.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a05c29cf-ac73-477c-941f-af2d8357f2b8_ext_2.jpg saved to cache
2025-12-04 10:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d8be1cec-e312-503e-a3eb-d5705c7c2660
2025-12-04 10:08:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd0c3d90>
2025-12-04 10:08:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:08:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8be1cec-e312-503e-a3eb-d5705c7c2660/d8be1cec-e312-503e-a3eb-d5705c7c2660_image_4.jpg HTTP/1.1" 201 0
2025-12-04 10:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa05c29cf-ac73-477c-941f-af2d8357f2b8_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a05c29cf-ac73-477c-941f-af2d8357f2b8_5.jpg saved to cache
2025-12-04 10:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d8be1cec-e312-503e-a3eb-d5705c7c2660
2025-12-04 10:08:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc7ec610>
2025-12-04 10:08:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:08:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8be1cec-e312-503e-a3eb-d5705c7c2660/d8be1cec-e312-503e-a3eb-d5705c7c2660_image_5.jpg HTTP/1.1" 201 0
2025-12-04 10:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa05c29cf-ac73-477c-941f-af2d8357f2b8_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a05c29cf-ac73-477c-941f-af2d8357f2b8_4.jpg saved to cache
2025-12-04 10:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d8be1cec-e312-503e-a3eb-d5705c7c2660
2025-12-04 10:08:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5c87d0>
2025-12-04 10:08:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:08:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8be1cec-e312-503e-a3eb-d5705c7c2660/d8be1cec-e312-503e-a3eb-d5705c7c2660_image_7.jpg HTTP/1.1" 201 0
2025-12-04 10:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa05c29cf-ac73-477c-941f-af2d8357f2b8_10.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a05c29cf-ac73-477c-941f-af2d8357f2b8_10.jpg saved to cache
2025-12-04 10:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d8be1cec-e312-503e-a3eb-d5705c7c2660
2025-12-04 10:08:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc7eda10>
2025-12-04 10:08:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:08:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8be1cec-e312-503e-a3eb-d5705c7c2660/d8be1cec-e312-503e-a3eb-d5705c7c2660_image_6.jpg HTTP/1.1" 201 0
2025-12-04 10:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa05c29cf-ac73-477c-941f-af2d8357f2b8_11.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a05c29cf-ac73-477c-941f-af2d8357f2b8_11.jpg saved to cache
2025-12-04 10:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d8be1cec-e312-503e-a3eb-d5705c7c2660
2025-12-04 10:08:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc53dd90>
2025-12-04 10:08:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:08:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8be1cec-e312-503e-a3eb-d5705c7c2660/d8be1cec-e312-503e-a3eb-d5705c7c2660_image_3.jpg HTTP/1.1" 201 0
2025-12-04 10:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa05c29cf-ac73-477c-941f-af2d8357f2b8_ext_1.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a05c29cf-ac73-477c-941f-af2d8357f2b8_ext_1.jpg saved to cache
2025-12-04 10:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d8be1cec-e312-503e-a3eb-d5705c7c2660
2025-12-04 10:08:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd0c2e90>
2025-12-04 10:08:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:08:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8be1cec-e312-503e-a3eb-d5705c7c2660/d8be1cec-e312-503e-a3eb-d5705c7c2660_image_1.jpg HTTP/1.1" 201 0
2025-12-04 10:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa05c29cf-ac73-477c-941f-af2d8357f2b8_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a05c29cf-ac73-477c-941f-af2d8357f2b8_ext_7.jpg saved to cache
2025-12-04 10:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d8be1cec-e312-503e-a3eb-d5705c7c2660
2025-12-04 10:08:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccfc2590>
2025-12-04 10:08:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:08:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8be1cec-e312-503e-a3eb-d5705c7c2660/d8be1cec-e312-503e-a3eb-d5705c7c2660_image_2.jpg HTTP/1.1" 201 0
2025-12-04 10:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa05c29cf-ac73-477c-941f-af2d8357f2b8_ext_6.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a05c29cf-ac73-477c-941f-af2d8357f2b8_ext_6.jpg saved to cache
2025-12-04 10:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d8be1cec-e312-503e-a3eb-d5705c7c2660
2025-12-04 10:08:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a05c29cf-ac73-477c-941f-af2d8357f2b8_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003613252-01984866-002.pdf)
2025-12-04 10:08:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3630205-3998328-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003630205-01980215-005.pdf)
2025-12-04 10:08:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3630205-3998328-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003630205-01980215-005.pdf)
2025-12-04 10:08:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3630205-3998328-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003630205-01980215-005.pdf)
2025-12-04 10:08:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3630205-3998328-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003630205-01980215-005.pdf)
2025-12-04 10:08:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3630205-3998328-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003630205-01980215-005.pdf)
2025-12-04 10:08:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3630205-3998328-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003630205-01980215-005.pdf)
2025-12-04 10:08:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3630205-3998328-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003630205-01980215-005.pdf)
2025-12-04 10:08:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd0611d0>
2025-12-04 10:08:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:08:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8be1cec-e312-503e-a3eb-d5705c7c2660/d8be1cec-e312-503e-a3eb-d5705c7c2660_image_0.jpg HTTP/1.1" 201 0
2025-12-04 10:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa05c29cf-ac73-477c-941f-af2d8357f2b8_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a05c29cf-ac73-477c-941f-af2d8357f2b8_ext_7.jpg saved to cache
2025-12-04 10:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d8be1cec-e312-503e-a3eb-d5705c7c2660
2025-12-04 10:08:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d8be1cec-e312-503e-a3eb-d5705c7c2660, skipping ID generation
2025-12-04 10:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Removing item d8be1cec-e312-503e-a3eb-d5705c7c2660 from tracking dictionaries
2025-12-04 10:08:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d8be1cec-e312-503e-a3eb-d5705c7c2660 sending to next pipeline
2025-12-04 10:08:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: d8be1cec-e312-503e-a3eb-d5705c7c2660, identifier: 3613252
2025-12-04 10:08:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: d8be1cec-e312-503e-a3eb-d5705c7c2660 with identifier: 3613252
2025-12-04 10:08:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-04 10:08:34 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Blue HTTP/1.1" 200 None
2025-12-04 10:08:34 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-04 10:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-04 10:08:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: d8be1cec-e312-503e-a3eb-d5705c7c2660 with identifier: 3613252
2025-12-04 10:08:34 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: d8be1cec-e312-503e-a3eb-d5705c7c2660 with identifier: 3613252 to the API
2025-12-04 10:08:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 10:08:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 10:08:35 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/a05c29cf-ac73-477c-941f-af2d8357f2b8_ext_7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8be1cec-e312-503e-a3eb-d5705c7c2660/d8be1cec-e312-503e-a3eb-d5705c7c2660_expert_report_file_59f56910-e401-469f-88fe-6565d5a47692.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003613252-01984866-002.pdf',
 'color': 'Blue',
 'currency': 'GBP',
 'engine': '1.0L',
 'expiration_date': '2025-12-05T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'd8be1cec-e312-503e-a3eb-d5705c7c2660',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'LR16ZBT',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FORD/FIESTA?id=3613252',
 'listing': 'auction',
 'location': 'Birmingham',
 'make': 'FORD',
 'model': 'FIESTA',
 'odometer': 71741,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 40,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8be1cec-e312-503e-a3eb-d5705c7c2660/d8be1cec-e312-503e-a3eb-d5705c7c2660_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 214517,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a05c29cf-ac73-477c-941f-af2d8357f2b8_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8be1cec-e312-503e-a3eb-d5705c7c2660/d8be1cec-e312-503e-a3eb-d5705c7c2660_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 214517,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a05c29cf-ac73-477c-941f-af2d8357f2b8_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8be1cec-e312-503e-a3eb-d5705c7c2660/d8be1cec-e312-503e-a3eb-d5705c7c2660_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 260353,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a05c29cf-ac73-477c-941f-af2d8357f2b8_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8be1cec-e312-503e-a3eb-d5705c7c2660/d8be1cec-e312-503e-a3eb-d5705c7c2660_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 199123,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a05c29cf-ac73-477c-941f-af2d8357f2b8_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8be1cec-e312-503e-a3eb-d5705c7c2660/d8be1cec-e312-503e-a3eb-d5705c7c2660_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 204315,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a05c29cf-ac73-477c-941f-af2d8357f2b8_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8be1cec-e312-503e-a3eb-d5705c7c2660/d8be1cec-e312-503e-a3eb-d5705c7c2660_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 208473,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a05c29cf-ac73-477c-941f-af2d8357f2b8_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8be1cec-e312-503e-a3eb-d5705c7c2660/d8be1cec-e312-503e-a3eb-d5705c7c2660_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 200616,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a05c29cf-ac73-477c-941f-af2d8357f2b8_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8be1cec-e312-503e-a3eb-d5705c7c2660/d8be1cec-e312-503e-a3eb-d5705c7c2660_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 210732,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a05c29cf-ac73-477c-941f-af2d8357f2b8_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8be1cec-e312-503e-a3eb-d5705c7c2660/d8be1cec-e312-503e-a3eb-d5705c7c2660_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 219922,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a05c29cf-ac73-477c-941f-af2d8357f2b8_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8be1cec-e312-503e-a3eb-d5705c7c2660/d8be1cec-e312-503e-a3eb-d5705c7c2660_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 277878,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a05c29cf-ac73-477c-941f-af2d8357f2b8_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8be1cec-e312-503e-a3eb-d5705c7c2660/d8be1cec-e312-503e-a3eb-d5705c7c2660_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 222739,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a05c29cf-ac73-477c-941f-af2d8357f2b8_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8be1cec-e312-503e-a3eb-d5705c7c2660/d8be1cec-e312-503e-a3eb-d5705c7c2660_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 226111,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a05c29cf-ac73-477c-941f-af2d8357f2b8_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8be1cec-e312-503e-a3eb-d5705c7c2660/d8be1cec-e312-503e-a3eb-d5705c7c2660_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 222987,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a05c29cf-ac73-477c-941f-af2d8357f2b8_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8be1cec-e312-503e-a3eb-d5705c7c2660/d8be1cec-e312-503e-a3eb-d5705c7c2660_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 242700,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3613252-4000724-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8be1cec-e312-503e-a3eb-d5705c7c2660/d8be1cec-e312-503e-a3eb-d5705c7c2660_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 275587,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3613252-4000724-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8be1cec-e312-503e-a3eb-d5705c7c2660/d8be1cec-e312-503e-a3eb-d5705c7c2660_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 290650,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3613252-4000724-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8be1cec-e312-503e-a3eb-d5705c7c2660/d8be1cec-e312-503e-a3eb-d5705c7c2660_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 318860,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3613252-4000724-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8be1cec-e312-503e-a3eb-d5705c7c2660/d8be1cec-e312-503e-a3eb-d5705c7c2660_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 412482,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3613252-4000724-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8be1cec-e312-503e-a3eb-d5705c7c2660/d8be1cec-e312-503e-a3eb-d5705c7c2660_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 323482,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3613252-4000724-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8be1cec-e312-503e-a3eb-d5705c7c2660/d8be1cec-e312-503e-a3eb-d5705c7c2660_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 257393,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3613252-4000724-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-18',
 'seller_name': 'Perrys',
 'title': 'FORD FIESTA 1.0 EcoBoost Titanium 5dr',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost Titanium 5dr',
 'year': 2016}
2025-12-04 10:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273613252%27 HTTP/1.1" 200 None
2025-12-04 10:08:35 [manheim.gb] INFO: Saving data for 3613252: {'created_time': 1764842915.058531, 'last_price_update_time': 1764842915.058542, 'auction_closing_time': 1764925200.0}
2025-12-04 10:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3613252') HTTP/1.1" 204 0
2025-12-04 10:08:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f232bf9e-f389-49a5-b917-f0cfbb98821c_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003630205-01980215-005.pdf)
2025-12-04 10:08:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f232bf9e-f389-49a5-b917-f0cfbb98821c_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003630205-01980215-005.pdf)
2025-12-04 10:08:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-363011-4004907-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000363011-01983801-002.pdf)
2025-12-04 10:08:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f232bf9e-f389-49a5-b917-f0cfbb98821c_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003630205-01980215-005.pdf)
2025-12-04 10:08:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f232bf9e-f389-49a5-b917-f0cfbb98821c_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003630205-01980215-005.pdf)
2025-12-04 10:08:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f232bf9e-f389-49a5-b917-f0cfbb98821c_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003630205-01980215-005.pdf)
2025-12-04 10:08:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd0a3850>
2025-12-04 10:08:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:08:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acaf763c-39c3-5001-bfe8-4cff2ff87c31/acaf763c-39c3-5001-bfe8-4cff2ff87c31_image_16.jpg HTTP/1.1" 201 0
2025-12-04 10:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3630205-3998328-1002.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3630205-3998328-1002.jpg saved to cache
2025-12-04 10:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item acaf763c-39c3-5001-bfe8-4cff2ff87c31
2025-12-04 10:08:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6f0910>
2025-12-04 10:08:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:08:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acaf763c-39c3-5001-bfe8-4cff2ff87c31/acaf763c-39c3-5001-bfe8-4cff2ff87c31_image_17.jpg HTTP/1.1" 201 0
2025-12-04 10:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3630205-3998328-1003.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3630205-3998328-1003.jpg saved to cache
2025-12-04 10:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item acaf763c-39c3-5001-bfe8-4cff2ff87c31
2025-12-04 10:08:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cceb3b90>
2025-12-04 10:08:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:08:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acaf763c-39c3-5001-bfe8-4cff2ff87c31/acaf763c-39c3-5001-bfe8-4cff2ff87c31_image_18.jpg HTTP/1.1" 201 0
2025-12-04 10:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3630205-3998328-1004.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3630205-3998328-1004.jpg saved to cache
2025-12-04 10:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item acaf763c-39c3-5001-bfe8-4cff2ff87c31
2025-12-04 10:08:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd0e86d0>
2025-12-04 10:08:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:08:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acaf763c-39c3-5001-bfe8-4cff2ff87c31/acaf763c-39c3-5001-bfe8-4cff2ff87c31_image_19.jpg HTTP/1.1" 201 0
2025-12-04 10:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3630205-3998328-1005.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3630205-3998328-1005.jpg saved to cache
2025-12-04 10:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item acaf763c-39c3-5001-bfe8-4cff2ff87c31
2025-12-04 10:08:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc611690>
2025-12-04 10:08:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:08:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acaf763c-39c3-5001-bfe8-4cff2ff87c31/acaf763c-39c3-5001-bfe8-4cff2ff87c31_image_15.jpg HTTP/1.1" 201 0
2025-12-04 10:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3630205-3998328-1001.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3630205-3998328-1001.jpg saved to cache
2025-12-04 10:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item acaf763c-39c3-5001-bfe8-4cff2ff87c31
2025-12-04 10:08:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc613010>
2025-12-04 10:08:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:08:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acaf763c-39c3-5001-bfe8-4cff2ff87c31/acaf763c-39c3-5001-bfe8-4cff2ff87c31_image_13.jpg HTTP/1.1" 201 0
2025-12-04 10:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3630205-3998328-13.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3630205-3998328-13.jpg saved to cache
2025-12-04 10:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item acaf763c-39c3-5001-bfe8-4cff2ff87c31
2025-12-04 10:08:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf59dd0>
2025-12-04 10:08:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:08:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acaf763c-39c3-5001-bfe8-4cff2ff87c31/acaf763c-39c3-5001-bfe8-4cff2ff87c31_image_14.jpg HTTP/1.1" 201 0
2025-12-04 10:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3630205-3998328-1000.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3630205-3998328-1000.jpg saved to cache
2025-12-04 10:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item acaf763c-39c3-5001-bfe8-4cff2ff87c31
2025-12-04 10:08:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3622898-4004520-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003622898-01985385-004.pdf)
2025-12-04 10:08:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f232bf9e-f389-49a5-b917-f0cfbb98821c_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003630205-01980215-005.pdf)
2025-12-04 10:08:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3622898-4004520-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003622898-01985385-004.pdf)
2025-12-04 10:08:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f232bf9e-f389-49a5-b917-f0cfbb98821c_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003630205-01980215-005.pdf)
2025-12-04 10:08:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f232bf9e-f389-49a5-b917-f0cfbb98821c_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003630205-01980215-005.pdf)
2025-12-04 10:08:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5e9f90>
2025-12-04 10:08:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 10:08:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acaf763c-39c3-5001-bfe8-4cff2ff87c31/acaf763c-39c3-5001-bfe8-4cff2ff87c31_image_10.jpg HTTP/1.1" 201 0
2025-12-04 10:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff232bf9e-f389-49a5-b917-f0cfbb98821c_ext_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f232bf9e-f389-49a5-b917-f0cfbb98821c_ext_5.jpg saved to cache
2025-12-04 10:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item acaf763c-39c3-5001-bfe8-4cff2ff87c31
2025-12-04 10:08:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc609250>
2025-12-04 10:08:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 10:08:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acaf763c-39c3-5001-bfe8-4cff2ff87c31/acaf763c-39c3-5001-bfe8-4cff2ff87c31_image_12.jpg HTTP/1.1" 201 0
2025-12-04 10:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff232bf9e-f389-49a5-b917-f0cfbb98821c_ext_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f232bf9e-f389-49a5-b917-f0cfbb98821c_ext_4.jpg saved to cache
2025-12-04 10:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item acaf763c-39c3-5001-bfe8-4cff2ff87c31
2025-12-04 10:08:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccec5610>
2025-12-04 10:08:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:08:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ba9d830-17c9-5bf8-86a6-04450b3e9296/1ba9d830-17c9-5bf8-86a6-04450b3e9296_image_14.jpg HTTP/1.1" 201 0
2025-12-04 10:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-363011-4004907-1000.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-363011-4004907-1000.jpg saved to cache
2025-12-04 10:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 1ba9d830-17c9-5bf8-86a6-04450b3e9296
2025-12-04 10:08:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf5a6d0>
2025-12-04 10:08:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:08:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acaf763c-39c3-5001-bfe8-4cff2ff87c31/acaf763c-39c3-5001-bfe8-4cff2ff87c31_image_2.jpg HTTP/1.1" 201 0
2025-12-04 10:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff232bf9e-f389-49a5-b917-f0cfbb98821c_ext_6.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f232bf9e-f389-49a5-b917-f0cfbb98821c_ext_6.jpg saved to cache
2025-12-04 10:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item acaf763c-39c3-5001-bfe8-4cff2ff87c31
2025-12-04 10:08:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd76390>
2025-12-04 10:08:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 10:08:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acaf763c-39c3-5001-bfe8-4cff2ff87c31/acaf763c-39c3-5001-bfe8-4cff2ff87c31_image_11.jpg HTTP/1.1" 201 0
2025-12-04 10:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff232bf9e-f389-49a5-b917-f0cfbb98821c_ext_3.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f232bf9e-f389-49a5-b917-f0cfbb98821c_ext_3.jpg saved to cache
2025-12-04 10:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item acaf763c-39c3-5001-bfe8-4cff2ff87c31
2025-12-04 10:08:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc67e890>
2025-12-04 10:08:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:08:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acaf763c-39c3-5001-bfe8-4cff2ff87c31/acaf763c-39c3-5001-bfe8-4cff2ff87c31_image_8.jpg HTTP/1.1" 201 0
2025-12-04 10:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff232bf9e-f389-49a5-b917-f0cfbb98821c_9.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f232bf9e-f389-49a5-b917-f0cfbb98821c_9.jpg saved to cache
2025-12-04 10:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item acaf763c-39c3-5001-bfe8-4cff2ff87c31
2025-12-04 10:08:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-363011-4004907-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000363011-01983801-002.pdf)
2025-12-04 10:08:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3622898-4004520-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003622898-01985385-004.pdf)
2025-12-04 10:08:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4e818afe-691b-4309-9d5c-6e489056b5f3_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000363011-01983801-002.pdf)
2025-12-04 10:08:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4e818afe-691b-4309-9d5c-6e489056b5f3_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000363011-01983801-002.pdf)
2025-12-04 10:08:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4e818afe-691b-4309-9d5c-6e489056b5f3_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000363011-01983801-002.pdf)
2025-12-04 10:08:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3622898-4004520-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003622898-01985385-004.pdf)
2025-12-04 10:08:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5a0290>
2025-12-04 10:08:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 10:08:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26ea40f5-de22-5022-b6fb-7b145e170b88/26ea40f5-de22-5022-b6fb-7b145e170b88_image_18.jpg HTTP/1.1" 201 0
2025-12-04 10:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3622898-4004520-1004.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3622898-4004520-1004.jpg saved to cache
2025-12-04 10:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 26ea40f5-de22-5022-b6fb-7b145e170b88
2025-12-04 10:08:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6da2d0>
2025-12-04 10:08:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:08:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acaf763c-39c3-5001-bfe8-4cff2ff87c31/acaf763c-39c3-5001-bfe8-4cff2ff87c31_image_9.jpg HTTP/1.1" 201 0
2025-12-04 10:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff232bf9e-f389-49a5-b917-f0cfbb98821c_ext_2.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f232bf9e-f389-49a5-b917-f0cfbb98821c_ext_2.jpg saved to cache
2025-12-04 10:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item acaf763c-39c3-5001-bfe8-4cff2ff87c31
2025-12-04 10:08:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc67d7d0>
2025-12-04 10:08:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:08:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26ea40f5-de22-5022-b6fb-7b145e170b88/26ea40f5-de22-5022-b6fb-7b145e170b88_image_17.jpg HTTP/1.1" 201 0
2025-12-04 10:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3622898-4004520-1003.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3622898-4004520-1003.jpg saved to cache
2025-12-04 10:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 26ea40f5-de22-5022-b6fb-7b145e170b88
2025-12-04 10:08:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5c21d0>
2025-12-04 10:08:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:08:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acaf763c-39c3-5001-bfe8-4cff2ff87c31/acaf763c-39c3-5001-bfe8-4cff2ff87c31_image_1.jpg HTTP/1.1" 201 0
2025-12-04 10:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff232bf9e-f389-49a5-b917-f0cfbb98821c_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f232bf9e-f389-49a5-b917-f0cfbb98821c_ext_7.jpg saved to cache
2025-12-04 10:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item acaf763c-39c3-5001-bfe8-4cff2ff87c31
2025-12-04 10:08:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6d8710>
2025-12-04 10:08:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:08:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acaf763c-39c3-5001-bfe8-4cff2ff87c31/acaf763c-39c3-5001-bfe8-4cff2ff87c31_image_0.jpg HTTP/1.1" 201 0
2025-12-04 10:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff232bf9e-f389-49a5-b917-f0cfbb98821c_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f232bf9e-f389-49a5-b917-f0cfbb98821c_ext_7.jpg saved to cache
2025-12-04 10:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item acaf763c-39c3-5001-bfe8-4cff2ff87c31
2025-12-04 10:08:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: acaf763c-39c3-5001-bfe8-4cff2ff87c31, skipping ID generation
2025-12-04 10:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Removing item acaf763c-39c3-5001-bfe8-4cff2ff87c31 from tracking dictionaries
2025-12-04 10:08:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item acaf763c-39c3-5001-bfe8-4cff2ff87c31 sending to next pipeline
2025-12-04 10:08:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: acaf763c-39c3-5001-bfe8-4cff2ff87c31, identifier: 3630205
2025-12-04 10:08:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: acaf763c-39c3-5001-bfe8-4cff2ff87c31 with identifier: 3630205
2025-12-04 10:08:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: acaf763c-39c3-5001-bfe8-4cff2ff87c31 with identifier: 3630205
2025-12-04 10:08:40 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: acaf763c-39c3-5001-bfe8-4cff2ff87c31 with identifier: 3630205 to the API
2025-12-04 10:08:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 10:08:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 10:08:40 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/f232bf9e-f389-49a5-b917-f0cfbb98821c_ext_7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acaf763c-39c3-5001-bfe8-4cff2ff87c31/acaf763c-39c3-5001-bfe8-4cff2ff87c31_expert_report_file_ac173280-ebfa-4bd2-ac12-31a3a5101acf.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003630205-01980215-005.pdf',
 'color': 'RED',
 'currency': 'GBP',
 'engine': '1.3L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'acaf763c-39c3-5001-bfe8-4cff2ff87c31',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'YE72CDU',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=3630205',
 'listing': 'auction',
 'location': 'Bristol',
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 16408,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 31,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acaf763c-39c3-5001-bfe8-4cff2ff87c31/acaf763c-39c3-5001-bfe8-4cff2ff87c31_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 258235,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f232bf9e-f389-49a5-b917-f0cfbb98821c_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acaf763c-39c3-5001-bfe8-4cff2ff87c31/acaf763c-39c3-5001-bfe8-4cff2ff87c31_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 258235,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f232bf9e-f389-49a5-b917-f0cfbb98821c_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acaf763c-39c3-5001-bfe8-4cff2ff87c31/acaf763c-39c3-5001-bfe8-4cff2ff87c31_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 164402,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f232bf9e-f389-49a5-b917-f0cfbb98821c_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acaf763c-39c3-5001-bfe8-4cff2ff87c31/acaf763c-39c3-5001-bfe8-4cff2ff87c31_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 254124,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f232bf9e-f389-49a5-b917-f0cfbb98821c_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acaf763c-39c3-5001-bfe8-4cff2ff87c31/acaf763c-39c3-5001-bfe8-4cff2ff87c31_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 259301,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f232bf9e-f389-49a5-b917-f0cfbb98821c_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acaf763c-39c3-5001-bfe8-4cff2ff87c31/acaf763c-39c3-5001-bfe8-4cff2ff87c31_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 240971,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f232bf9e-f389-49a5-b917-f0cfbb98821c_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acaf763c-39c3-5001-bfe8-4cff2ff87c31/acaf763c-39c3-5001-bfe8-4cff2ff87c31_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 219305,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f232bf9e-f389-49a5-b917-f0cfbb98821c_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acaf763c-39c3-5001-bfe8-4cff2ff87c31/acaf763c-39c3-5001-bfe8-4cff2ff87c31_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 223469,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f232bf9e-f389-49a5-b917-f0cfbb98821c_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acaf763c-39c3-5001-bfe8-4cff2ff87c31/acaf763c-39c3-5001-bfe8-4cff2ff87c31_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 238970,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f232bf9e-f389-49a5-b917-f0cfbb98821c_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acaf763c-39c3-5001-bfe8-4cff2ff87c31/acaf763c-39c3-5001-bfe8-4cff2ff87c31_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 301016,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f232bf9e-f389-49a5-b917-f0cfbb98821c_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acaf763c-39c3-5001-bfe8-4cff2ff87c31/acaf763c-39c3-5001-bfe8-4cff2ff87c31_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 179449,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f232bf9e-f389-49a5-b917-f0cfbb98821c_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acaf763c-39c3-5001-bfe8-4cff2ff87c31/acaf763c-39c3-5001-bfe8-4cff2ff87c31_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 221947,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f232bf9e-f389-49a5-b917-f0cfbb98821c_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acaf763c-39c3-5001-bfe8-4cff2ff87c31/acaf763c-39c3-5001-bfe8-4cff2ff87c31_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 137197,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f232bf9e-f389-49a5-b917-f0cfbb98821c_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acaf763c-39c3-5001-bfe8-4cff2ff87c31/acaf763c-39c3-5001-bfe8-4cff2ff87c31_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 346912,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3630205-3998328-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acaf763c-39c3-5001-bfe8-4cff2ff87c31/acaf763c-39c3-5001-bfe8-4cff2ff87c31_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 328608,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3630205-3998328-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acaf763c-39c3-5001-bfe8-4cff2ff87c31/acaf763c-39c3-5001-bfe8-4cff2ff87c31_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 346620,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3630205-3998328-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acaf763c-39c3-5001-bfe8-4cff2ff87c31/acaf763c-39c3-5001-bfe8-4cff2ff87c31_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 249368,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3630205-3998328-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acaf763c-39c3-5001-bfe8-4cff2ff87c31/acaf763c-39c3-5001-bfe8-4cff2ff87c31_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 224233,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3630205-3998328-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acaf763c-39c3-5001-bfe8-4cff2ff87c31/acaf763c-39c3-5001-bfe8-4cff2ff87c31_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 283359,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3630205-3998328-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acaf763c-39c3-5001-bfe8-4cff2ff87c31/acaf763c-39c3-5001-bfe8-4cff2ff87c31_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 273871,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3630205-3998328-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-18',
 'seller_name': 'Mobilize Financial Services',
 'title': 'NISSAN QASHQAI 1.3 DiG-T MH Acenta Premium 5dr',
 'transmission': 'manual',
 'trim': '1.3 DiG-T MH Acenta Premium 5dr',
 'year': 2022}
2025-12-04 10:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273630205%27 HTTP/1.1" 200 None
2025-12-04 10:08:40 [manheim.gb] INFO: Saving data for 3630205: {'created_time': 1764842920.988076, 'last_price_update_time': 1764842920.988086, 'auction_closing_time': 1765270800.0}
2025-12-04 10:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3630205') HTTP/1.1" 204 0
2025-12-04 10:08:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/MAZDA/3?id=3603120&returnUrl=%2Fsearch%3FPage%3D4%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233603120&indx=309> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 10:08:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/FORD/KUGA?id=3612695&returnUrl=%2Fsearch%3FPage%3D4%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233612695&indx=310> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 10:08:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4e818afe-691b-4309-9d5c-6e489056b5f3_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000363011-01983801-002.pdf)
2025-12-04 10:08:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0bdf4d14-d195-4bb6-8158-eb3ff5c96ff9_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003622898-01985385-004.pdf)
2025-12-04 10:08:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4e818afe-691b-4309-9d5c-6e489056b5f3_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000363011-01983801-002.pdf)
2025-12-04 10:08:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 10:08:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 10:08:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6d0290>
2025-12-04 10:08:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:08:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ba9d830-17c9-5bf8-86a6-04450b3e9296/1ba9d830-17c9-5bf8-86a6-04450b3e9296_image_13.jpg HTTP/1.1" 201 0
2025-12-04 10:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-363011-4004907-13.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-363011-4004907-13.jpg saved to cache
2025-12-04 10:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 1ba9d830-17c9-5bf8-86a6-04450b3e9296
2025-12-04 10:08:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5f4a50>
2025-12-04 10:08:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:08:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26ea40f5-de22-5022-b6fb-7b145e170b88/26ea40f5-de22-5022-b6fb-7b145e170b88_image_15.jpg HTTP/1.1" 201 0
2025-12-04 10:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3622898-4004520-1001.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3622898-4004520-1001.jpg saved to cache
2025-12-04 10:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 26ea40f5-de22-5022-b6fb-7b145e170b88
2025-12-04 10:08:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc570510>
2025-12-04 10:08:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:08:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ba9d830-17c9-5bf8-86a6-04450b3e9296/1ba9d830-17c9-5bf8-86a6-04450b3e9296_image_10.jpg HTTP/1.1" 201 0
2025-12-04 10:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4e818afe-691b-4309-9d5c-6e489056b5f3_ext_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4e818afe-691b-4309-9d5c-6e489056b5f3_ext_5.jpg saved to cache
2025-12-04 10:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 1ba9d830-17c9-5bf8-86a6-04450b3e9296
2025-12-04 10:08:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc571590>
2025-12-04 10:08:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:08:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ba9d830-17c9-5bf8-86a6-04450b3e9296/1ba9d830-17c9-5bf8-86a6-04450b3e9296_image_11.jpg HTTP/1.1" 201 0
2025-12-04 10:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4e818afe-691b-4309-9d5c-6e489056b5f3_ext_3.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4e818afe-691b-4309-9d5c-6e489056b5f3_ext_3.jpg saved to cache
2025-12-04 10:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 1ba9d830-17c9-5bf8-86a6-04450b3e9296
2025-12-04 10:08:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce64390>
2025-12-04 10:08:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:08:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ba9d830-17c9-5bf8-86a6-04450b3e9296/1ba9d830-17c9-5bf8-86a6-04450b3e9296_image_12.jpg HTTP/1.1" 201 0
2025-12-04 10:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4e818afe-691b-4309-9d5c-6e489056b5f3_ext_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4e818afe-691b-4309-9d5c-6e489056b5f3_ext_4.jpg saved to cache
2025-12-04 10:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 1ba9d830-17c9-5bf8-86a6-04450b3e9296
2025-12-04 10:08:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd0eb910>
2025-12-04 10:08:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:08:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26ea40f5-de22-5022-b6fb-7b145e170b88/26ea40f5-de22-5022-b6fb-7b145e170b88_image_16.jpg HTTP/1.1" 201 0
2025-12-04 10:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3622898-4004520-1002.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3622898-4004520-1002.jpg saved to cache
2025-12-04 10:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 26ea40f5-de22-5022-b6fb-7b145e170b88
2025-12-04 10:08:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3622898-4004520-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003622898-01985385-004.pdf)
2025-12-04 10:08:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3622898-4004520-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003622898-01985385-004.pdf)
2025-12-04 10:08:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4e818afe-691b-4309-9d5c-6e489056b5f3_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000363011-01983801-002.pdf)
2025-12-04 10:08:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4e818afe-691b-4309-9d5c-6e489056b5f3_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000363011-01983801-002.pdf)
2025-12-04 10:08:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0bdf4d14-d195-4bb6-8158-eb3ff5c96ff9_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003622898-01985385-004.pdf)
2025-12-04 10:08:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 10:08:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03 with identifier: 3603120
2025-12-04 10:08:42 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03
2025-12-04 10:08:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72aa258f-b6f1-589c-bbc5-46b8611b81de with identifier: 3612695
2025-12-04 10:08:42 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 72aa258f-b6f1-589c-bbc5-46b8611b81de
2025-12-04 10:08:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccc81490>
2025-12-04 10:08:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 10:08:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ba9d830-17c9-5bf8-86a6-04450b3e9296/1ba9d830-17c9-5bf8-86a6-04450b3e9296_image_9.jpg HTTP/1.1" 201 0
2025-12-04 10:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4e818afe-691b-4309-9d5c-6e489056b5f3_ext_2.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4e818afe-691b-4309-9d5c-6e489056b5f3_ext_2.jpg saved to cache
2025-12-04 10:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1ba9d830-17c9-5bf8-86a6-04450b3e9296
2025-12-04 10:08:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5e8050>
2025-12-04 10:08:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:08:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26ea40f5-de22-5022-b6fb-7b145e170b88/26ea40f5-de22-5022-b6fb-7b145e170b88_image_12.jpg HTTP/1.1" 201 0
2025-12-04 10:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0bdf4d14-d195-4bb6-8158-eb3ff5c96ff9_ext_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0bdf4d14-d195-4bb6-8158-eb3ff5c96ff9_ext_4.jpg saved to cache
2025-12-04 10:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 26ea40f5-de22-5022-b6fb-7b145e170b88
2025-12-04 10:08:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc7f8b10>
2025-12-04 10:08:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:08:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ba9d830-17c9-5bf8-86a6-04450b3e9296/1ba9d830-17c9-5bf8-86a6-04450b3e9296_image_8.jpg HTTP/1.1" 201 0
2025-12-04 10:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4e818afe-691b-4309-9d5c-6e489056b5f3_9.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4e818afe-691b-4309-9d5c-6e489056b5f3_9.jpg saved to cache
2025-12-04 10:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1ba9d830-17c9-5bf8-86a6-04450b3e9296
2025-12-04 10:08:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/ABARTH/595?id=3595741&returnUrl=%2Fsearch%3FPage%3D4%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233595741&indx=308> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 10:08:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4a84e7fd-e03b-494b-af2a-02ac1b2a19e4_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001564179-01991001-001.pdf)
2025-12-04 10:08:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0bdf4d14-d195-4bb6-8158-eb3ff5c96ff9_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003622898-01985385-004.pdf)
2025-12-04 10:08:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0bdf4d14-d195-4bb6-8158-eb3ff5c96ff9_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003622898-01985385-004.pdf)
2025-12-04 10:08:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4a84e7fd-e03b-494b-af2a-02ac1b2a19e4_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001564179-01991001-001.pdf)
2025-12-04 10:08:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/936490aa-3134-4728-b2c9-3885f9adf43f_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001761741-01991419-003.pdf)
2025-12-04 10:08:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 10:08:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf5ae50>
2025-12-04 10:08:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:08:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26ea40f5-de22-5022-b6fb-7b145e170b88/26ea40f5-de22-5022-b6fb-7b145e170b88_image_14.jpg HTTP/1.1" 201 0
2025-12-04 10:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3622898-4004520-1000.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3622898-4004520-1000.jpg saved to cache
2025-12-04 10:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 26ea40f5-de22-5022-b6fb-7b145e170b88
2025-12-04 10:08:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd11f910>
2025-12-04 10:08:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:08:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26ea40f5-de22-5022-b6fb-7b145e170b88/26ea40f5-de22-5022-b6fb-7b145e170b88_image_13.jpg HTTP/1.1" 201 0
2025-12-04 10:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3622898-4004520-13.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3622898-4004520-13.jpg saved to cache
2025-12-04 10:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 26ea40f5-de22-5022-b6fb-7b145e170b88
2025-12-04 10:08:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd0a15d0>
2025-12-04 10:08:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:08:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ba9d830-17c9-5bf8-86a6-04450b3e9296/1ba9d830-17c9-5bf8-86a6-04450b3e9296_image_7.jpg HTTP/1.1" 201 0
2025-12-04 10:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4e818afe-691b-4309-9d5c-6e489056b5f3_10.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4e818afe-691b-4309-9d5c-6e489056b5f3_10.jpg saved to cache
2025-12-04 10:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1ba9d830-17c9-5bf8-86a6-04450b3e9296
2025-12-04 10:08:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce081d0>
2025-12-04 10:08:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:08:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ba9d830-17c9-5bf8-86a6-04450b3e9296/1ba9d830-17c9-5bf8-86a6-04450b3e9296_image_6.jpg HTTP/1.1" 201 0
2025-12-04 10:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4e818afe-691b-4309-9d5c-6e489056b5f3_11.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4e818afe-691b-4309-9d5c-6e489056b5f3_11.jpg saved to cache
2025-12-04 10:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1ba9d830-17c9-5bf8-86a6-04450b3e9296
2025-12-04 10:08:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1ba9d830-17c9-5bf8-86a6-04450b3e9296, skipping ID generation
2025-12-04 10:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 1ba9d830-17c9-5bf8-86a6-04450b3e9296 from tracking dictionaries
2025-12-04 10:08:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1ba9d830-17c9-5bf8-86a6-04450b3e9296 sending to next pipeline
2025-12-04 10:08:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 1ba9d830-17c9-5bf8-86a6-04450b3e9296, identifier: 363011
2025-12-04 10:08:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce64910>
2025-12-04 10:08:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:08:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26ea40f5-de22-5022-b6fb-7b145e170b88/26ea40f5-de22-5022-b6fb-7b145e170b88_image_11.jpg HTTP/1.1" 201 0
2025-12-04 10:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0bdf4d14-d195-4bb6-8158-eb3ff5c96ff9_ext_3.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0bdf4d14-d195-4bb6-8158-eb3ff5c96ff9_ext_3.jpg saved to cache
2025-12-04 10:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 26ea40f5-de22-5022-b6fb-7b145e170b88
2025-12-04 10:08:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0bdf4d14-d195-4bb6-8158-eb3ff5c96ff9_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003622898-01985385-004.pdf)
2025-12-04 10:08:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1564179-4007572-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001564179-01991001-001.pdf)
2025-12-04 10:08:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1761741-4007528-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001761741-01991419-003.pdf)
2025-12-04 10:08:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 1ba9d830-17c9-5bf8-86a6-04450b3e9296 with identifier: 363011
2025-12-04 10:08:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 1ba9d830-17c9-5bf8-86a6-04450b3e9296 with identifier: 363011
2025-12-04 10:08:45 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 13 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    13
2025-12-04 10:08:45 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: 1ba9d830-17c9-5bf8-86a6-04450b3e9296 spider: manheim.gb
2025-12-04 10:08:45 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 1ba9d830-17c9-5bf8-86a6-04450b3e9296 due to rule: registration_date_old.json, error: 13 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    13
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ba9d830-17c9-5bf8-86a6-04450b3e9296/1ba9d830-17c9-5bf8-86a6-04450b3e9296_expert_report_file_32b74b18-b752-40ed-b9b8-5886214ba359.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0000363011-01983801-002.pdf',
 'color': 'RED',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '1ba9d830-17c9-5bf8-86a6-04450b3e9296',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'DV62LXR',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FORD/KA?id=363011',
 'listing': 'auction',
 'location': 'Leeds',
 'make': 'FORD',
 'model': 'KA',
 'odometer': 77318,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ba9d830-17c9-5bf8-86a6-04450b3e9296/1ba9d830-17c9-5bf8-86a6-04450b3e9296_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 220460,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4e818afe-691b-4309-9d5c-6e489056b5f3_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ba9d830-17c9-5bf8-86a6-04450b3e9296/1ba9d830-17c9-5bf8-86a6-04450b3e9296_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 220460,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4e818afe-691b-4309-9d5c-6e489056b5f3_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ba9d830-17c9-5bf8-86a6-04450b3e9296/1ba9d830-17c9-5bf8-86a6-04450b3e9296_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 252423,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4e818afe-691b-4309-9d5c-6e489056b5f3_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ba9d830-17c9-5bf8-86a6-04450b3e9296/1ba9d830-17c9-5bf8-86a6-04450b3e9296_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 154738,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4e818afe-691b-4309-9d5c-6e489056b5f3_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ba9d830-17c9-5bf8-86a6-04450b3e9296/1ba9d830-17c9-5bf8-86a6-04450b3e9296_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 188784,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4e818afe-691b-4309-9d5c-6e489056b5f3_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ba9d830-17c9-5bf8-86a6-04450b3e9296/1ba9d830-17c9-5bf8-86a6-04450b3e9296_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 181410,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4e818afe-691b-4309-9d5c-6e489056b5f3_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ba9d830-17c9-5bf8-86a6-04450b3e9296/1ba9d830-17c9-5bf8-86a6-04450b3e9296_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 210838,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4e818afe-691b-4309-9d5c-6e489056b5f3_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ba9d830-17c9-5bf8-86a6-04450b3e9296/1ba9d830-17c9-5bf8-86a6-04450b3e9296_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 201695,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4e818afe-691b-4309-9d5c-6e489056b5f3_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ba9d830-17c9-5bf8-86a6-04450b3e9296/1ba9d830-17c9-5bf8-86a6-04450b3e9296_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 213238,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4e818afe-691b-4309-9d5c-6e489056b5f3_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ba9d830-17c9-5bf8-86a6-04450b3e9296/1ba9d830-17c9-5bf8-86a6-04450b3e9296_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 261729,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4e818afe-691b-4309-9d5c-6e489056b5f3_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ba9d830-17c9-5bf8-86a6-04450b3e9296/1ba9d830-17c9-5bf8-86a6-04450b3e9296_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 189867,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4e818afe-691b-4309-9d5c-6e489056b5f3_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ba9d830-17c9-5bf8-86a6-04450b3e9296/1ba9d830-17c9-5bf8-86a6-04450b3e9296_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 211918,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4e818afe-691b-4309-9d5c-6e489056b5f3_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ba9d830-17c9-5bf8-86a6-04450b3e9296/1ba9d830-17c9-5bf8-86a6-04450b3e9296_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 254208,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4e818afe-691b-4309-9d5c-6e489056b5f3_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ba9d830-17c9-5bf8-86a6-04450b3e9296/1ba9d830-17c9-5bf8-86a6-04450b3e9296_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 371910,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-363011-4004907-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ba9d830-17c9-5bf8-86a6-04450b3e9296/1ba9d830-17c9-5bf8-86a6-04450b3e9296_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 187686,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-363011-4004907-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ba9d830-17c9-5bf8-86a6-04450b3e9296/1ba9d830-17c9-5bf8-86a6-04450b3e9296_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 205578,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-363011-4004907-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ba9d830-17c9-5bf8-86a6-04450b3e9296/1ba9d830-17c9-5bf8-86a6-04450b3e9296_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 364796,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-363011-4004907-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ba9d830-17c9-5bf8-86a6-04450b3e9296/1ba9d830-17c9-5bf8-86a6-04450b3e9296_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 235876,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-363011-4004907-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ba9d830-17c9-5bf8-86a6-04450b3e9296/1ba9d830-17c9-5bf8-86a6-04450b3e9296_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 278456,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-363011-4004907-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ba9d830-17c9-5bf8-86a6-04450b3e9296/1ba9d830-17c9-5bf8-86a6-04450b3e9296_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 262310,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-363011-4004907-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-14',
 'seller_name': 'Lookers',
 'title': 'FORD KA 1.2 Edge 3dr [Start Stop]',
 'transmission': 'manual',
 'trim': '1.2 Edge 3dr [Start Stop]',
 'year': 2012}
2025-12-04 10:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27363011%27 HTTP/1.1" 200 None
2025-12-04 10:08:45 [manheim.gb] INFO: Saving data for 363011: {'created_time': 1764842925.476545, 'last_price_update_time': 1764842925.476554, 'auction_closing_time': 1765184400.0}
2025-12-04 10:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='363011') HTTP/1.1" 204 0
2025-12-04 10:08:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/936490aa-3134-4728-b2c9-3885f9adf43f_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001761741-01991419-003.pdf)
2025-12-04 10:08:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd0352b1-6dcd-5f8c-abf1-303ebe222f63 with identifier: 3595741
2025-12-04 10:08:45 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item bd0352b1-6dcd-5f8c-abf1-303ebe222f63
2025-12-04 10:08:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccc4ab90>
2025-12-04 10:08:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:08:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9200c31a-aec5-5dca-8036-0876fcfb70f2/9200c31a-aec5-5dca-8036-0876fcfb70f2_image_11.jpg HTTP/1.1" 201 0
2025-12-04 10:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4a84e7fd-e03b-494b-af2a-02ac1b2a19e4_ext_3.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4a84e7fd-e03b-494b-af2a-02ac1b2a19e4_ext_3.jpg saved to cache
2025-12-04 10:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 9200c31a-aec5-5dca-8036-0876fcfb70f2
2025-12-04 10:08:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccfc2450>
2025-12-04 10:08:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:08:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26ea40f5-de22-5022-b6fb-7b145e170b88/26ea40f5-de22-5022-b6fb-7b145e170b88_image_10.jpg HTTP/1.1" 201 0
2025-12-04 10:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0bdf4d14-d195-4bb6-8158-eb3ff5c96ff9_ext_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0bdf4d14-d195-4bb6-8158-eb3ff5c96ff9_ext_5.jpg saved to cache
2025-12-04 10:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 26ea40f5-de22-5022-b6fb-7b145e170b88
2025-12-04 10:08:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc53c910>
2025-12-04 10:08:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:08:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26ea40f5-de22-5022-b6fb-7b145e170b88/26ea40f5-de22-5022-b6fb-7b145e170b88_image_5.jpg HTTP/1.1" 201 0
2025-12-04 10:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0bdf4d14-d195-4bb6-8158-eb3ff5c96ff9_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0bdf4d14-d195-4bb6-8158-eb3ff5c96ff9_4.jpg saved to cache
2025-12-04 10:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 26ea40f5-de22-5022-b6fb-7b145e170b88
2025-12-04 10:08:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6087d0>
2025-12-04 10:08:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 10:08:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9200c31a-aec5-5dca-8036-0876fcfb70f2/9200c31a-aec5-5dca-8036-0876fcfb70f2_image_12.jpg HTTP/1.1" 201 0
2025-12-04 10:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4a84e7fd-e03b-494b-af2a-02ac1b2a19e4_ext_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4a84e7fd-e03b-494b-af2a-02ac1b2a19e4_ext_4.jpg saved to cache
2025-12-04 10:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 9200c31a-aec5-5dca-8036-0876fcfb70f2
2025-12-04 10:08:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5f4a90>
2025-12-04 10:08:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:08:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08d45d44-06c8-5777-ab82-d212449d4408/08d45d44-06c8-5777-ab82-d212449d4408_image_12.jpg HTTP/1.1" 201 0
2025-12-04 10:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F936490aa-3134-4728-b2c9-3885f9adf43f_ext_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/936490aa-3134-4728-b2c9-3885f9adf43f_ext_4.jpg saved to cache
2025-12-04 10:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 08d45d44-06c8-5777-ab82-d212449d4408
2025-12-04 10:08:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc68e650>
2025-12-04 10:08:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:08:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26ea40f5-de22-5022-b6fb-7b145e170b88/26ea40f5-de22-5022-b6fb-7b145e170b88_image_9.jpg HTTP/1.1" 201 0
2025-12-04 10:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0bdf4d14-d195-4bb6-8158-eb3ff5c96ff9_ext_2.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0bdf4d14-d195-4bb6-8158-eb3ff5c96ff9_ext_2.jpg saved to cache
2025-12-04 10:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 26ea40f5-de22-5022-b6fb-7b145e170b88
2025-12-04 10:08:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 26ea40f5-de22-5022-b6fb-7b145e170b88, skipping ID generation
2025-12-04 10:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 26ea40f5-de22-5022-b6fb-7b145e170b88 from tracking dictionaries
2025-12-04 10:08:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 26ea40f5-de22-5022-b6fb-7b145e170b88 sending to next pipeline
2025-12-04 10:08:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 26ea40f5-de22-5022-b6fb-7b145e170b88, identifier: 3622898
2025-12-04 10:08:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccfc0810>
2025-12-04 10:08:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 10:08:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9200c31a-aec5-5dca-8036-0876fcfb70f2/9200c31a-aec5-5dca-8036-0876fcfb70f2_image_13.jpg HTTP/1.1" 201 0
2025-12-04 10:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1564179-4007572-13.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1564179-4007572-13.jpg saved to cache
2025-12-04 10:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 9200c31a-aec5-5dca-8036-0876fcfb70f2
2025-12-04 10:08:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5c8910>
2025-12-04 10:08:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:08:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08d45d44-06c8-5777-ab82-d212449d4408/08d45d44-06c8-5777-ab82-d212449d4408_image_13.jpg HTTP/1.1" 201 0
2025-12-04 10:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1761741-4007528-13.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1761741-4007528-13.jpg saved to cache
2025-12-04 10:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 08d45d44-06c8-5777-ab82-d212449d4408
2025-12-04 10:08:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 26ea40f5-de22-5022-b6fb-7b145e170b88 with identifier: 3622898
2025-12-04 10:08:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 26ea40f5-de22-5022-b6fb-7b145e170b88 with identifier: 3622898
2025-12-04 10:08:47 [scrapy.core.scraper] INFO: Dropped: Dropping expired listing: 26ea40f5-de22-5022-b6fb-7b145e170b88 with expiration date: 2025-12-04T09:00:00Z
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26ea40f5-de22-5022-b6fb-7b145e170b88/26ea40f5-de22-5022-b6fb-7b145e170b88_expert_report_file_e2ab92c1-cf6f-4cfb-be0f-61a50ce0b305.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003622898-01985385-004.pdf',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '0.0L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Electric',
 'id': '26ea40f5-de22-5022-b6fb-7b145e170b88',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'HY71BVB',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MG/MG5?id=3622898',
 'listing': 'auction',
 'location': 'Northampton',
 'make': 'MG',
 'model': 'MG5',
 'odometer': 114104,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26ea40f5-de22-5022-b6fb-7b145e170b88/26ea40f5-de22-5022-b6fb-7b145e170b88_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 207897,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0bdf4d14-d195-4bb6-8158-eb3ff5c96ff9_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26ea40f5-de22-5022-b6fb-7b145e170b88/26ea40f5-de22-5022-b6fb-7b145e170b88_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 207897,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0bdf4d14-d195-4bb6-8158-eb3ff5c96ff9_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26ea40f5-de22-5022-b6fb-7b145e170b88/26ea40f5-de22-5022-b6fb-7b145e170b88_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 247683,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0bdf4d14-d195-4bb6-8158-eb3ff5c96ff9_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26ea40f5-de22-5022-b6fb-7b145e170b88/26ea40f5-de22-5022-b6fb-7b145e170b88_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 226130,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0bdf4d14-d195-4bb6-8158-eb3ff5c96ff9_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26ea40f5-de22-5022-b6fb-7b145e170b88/26ea40f5-de22-5022-b6fb-7b145e170b88_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 228500,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0bdf4d14-d195-4bb6-8158-eb3ff5c96ff9_5.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26ea40f5-de22-5022-b6fb-7b145e170b88/26ea40f5-de22-5022-b6fb-7b145e170b88_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 221575,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0bdf4d14-d195-4bb6-8158-eb3ff5c96ff9_4.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26ea40f5-de22-5022-b6fb-7b145e170b88/26ea40f5-de22-5022-b6fb-7b145e170b88_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 209119,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0bdf4d14-d195-4bb6-8158-eb3ff5c96ff9_11.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26ea40f5-de22-5022-b6fb-7b145e170b88/26ea40f5-de22-5022-b6fb-7b145e170b88_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 216223,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0bdf4d14-d195-4bb6-8158-eb3ff5c96ff9_10.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26ea40f5-de22-5022-b6fb-7b145e170b88/26ea40f5-de22-5022-b6fb-7b145e170b88_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 204093,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0bdf4d14-d195-4bb6-8158-eb3ff5c96ff9_9.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26ea40f5-de22-5022-b6fb-7b145e170b88/26ea40f5-de22-5022-b6fb-7b145e170b88_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 295773,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0bdf4d14-d195-4bb6-8158-eb3ff5c96ff9_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26ea40f5-de22-5022-b6fb-7b145e170b88/26ea40f5-de22-5022-b6fb-7b145e170b88_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 237650,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0bdf4d14-d195-4bb6-8158-eb3ff5c96ff9_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26ea40f5-de22-5022-b6fb-7b145e170b88/26ea40f5-de22-5022-b6fb-7b145e170b88_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 253060,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0bdf4d14-d195-4bb6-8158-eb3ff5c96ff9_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26ea40f5-de22-5022-b6fb-7b145e170b88/26ea40f5-de22-5022-b6fb-7b145e170b88_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 219271,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0bdf4d14-d195-4bb6-8158-eb3ff5c96ff9_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26ea40f5-de22-5022-b6fb-7b145e170b88/26ea40f5-de22-5022-b6fb-7b145e170b88_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 270521,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3622898-4004520-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26ea40f5-de22-5022-b6fb-7b145e170b88/26ea40f5-de22-5022-b6fb-7b145e170b88_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 270886,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3622898-4004520-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26ea40f5-de22-5022-b6fb-7b145e170b88/26ea40f5-de22-5022-b6fb-7b145e170b88_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 162698,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3622898-4004520-1001.jpg',
             'Width': 749},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26ea40f5-de22-5022-b6fb-7b145e170b88/26ea40f5-de22-5022-b6fb-7b145e170b88_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 239249,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3622898-4004520-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26ea40f5-de22-5022-b6fb-7b145e170b88/26ea40f5-de22-5022-b6fb-7b145e170b88_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 192837,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3622898-4004520-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26ea40f5-de22-5022-b6fb-7b145e170b88/26ea40f5-de22-5022-b6fb-7b145e170b88_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 287731,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3622898-4004520-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26ea40f5-de22-5022-b6fb-7b145e170b88/26ea40f5-de22-5022-b6fb-7b145e170b88_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 141811,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3622898-4004520-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-05',
 'seller_name': 'Sycamore',
 'title': 'MG MG5 115kW Exclusive EV 61kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '115kW Exclusive EV 61kWh 5dr Auto',
 'year': 2022}
2025-12-04 10:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273622898%27 HTTP/1.1" 200 None
2025-12-04 10:08:48 [manheim.gb] INFO: Saving data for 3622898: {'created_time': 1764842928.016082, 'last_price_update_time': 1764842928.016093, 'auction_closing_time': 1764838800.0}
2025-12-04 10:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3622898') HTTP/1.1" 204 0
2025-12-04 10:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/E220?id=3591726&returnUrl=%2Fsearch%3FPage%3D4%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233591726&indx=307> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 10:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/936490aa-3134-4728-b2c9-3885f9adf43f_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001761741-01991419-003.pdf)
2025-12-04 10:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4a84e7fd-e03b-494b-af2a-02ac1b2a19e4_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001564179-01991001-001.pdf)
2025-12-04 10:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/936490aa-3134-4728-b2c9-3885f9adf43f_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001761741-01991419-003.pdf)
2025-12-04 10:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4a84e7fd-e03b-494b-af2a-02ac1b2a19e4_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001564179-01991001-001.pdf)
2025-12-04 10:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/936490aa-3134-4728-b2c9-3885f9adf43f_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001761741-01991419-003.pdf)
2025-12-04 10:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4a84e7fd-e03b-494b-af2a-02ac1b2a19e4_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001564179-01991001-001.pdf)
2025-12-04 10:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4a84e7fd-e03b-494b-af2a-02ac1b2a19e4_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001564179-01991001-001.pdf)
2025-12-04 10:08:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccc76a90>
2025-12-04 10:08:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:08:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08d45d44-06c8-5777-ab82-d212449d4408/08d45d44-06c8-5777-ab82-d212449d4408_image_11.jpg HTTP/1.1" 201 0
2025-12-04 10:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F936490aa-3134-4728-b2c9-3885f9adf43f_ext_3.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/936490aa-3134-4728-b2c9-3885f9adf43f_ext_3.jpg saved to cache
2025-12-04 10:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 08d45d44-06c8-5777-ab82-d212449d4408
2025-12-04 10:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/936490aa-3134-4728-b2c9-3885f9adf43f_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001761741-01991419-003.pdf)
2025-12-04 10:08:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9152002f-8509-5dfc-8979-17e1975e2490 with identifier: 3591726
2025-12-04 10:08:48 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 9152002f-8509-5dfc-8979-17e1975e2490
2025-12-04 10:08:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd0f5590>
2025-12-04 10:08:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:08:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08d45d44-06c8-5777-ab82-d212449d4408/08d45d44-06c8-5777-ab82-d212449d4408_image_8.jpg HTTP/1.1" 201 0
2025-12-04 10:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F936490aa-3134-4728-b2c9-3885f9adf43f_9.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/936490aa-3134-4728-b2c9-3885f9adf43f_9.jpg saved to cache
2025-12-04 10:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 08d45d44-06c8-5777-ab82-d212449d4408
2025-12-04 10:08:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccca9250>
2025-12-04 10:08:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:08:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9200c31a-aec5-5dca-8036-0876fcfb70f2/9200c31a-aec5-5dca-8036-0876fcfb70f2_image_7.jpg HTTP/1.1" 201 0
2025-12-04 10:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4a84e7fd-e03b-494b-af2a-02ac1b2a19e4_10.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4a84e7fd-e03b-494b-af2a-02ac1b2a19e4_10.jpg saved to cache
2025-12-04 10:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9200c31a-aec5-5dca-8036-0876fcfb70f2
2025-12-04 10:08:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce87d10>
2025-12-04 10:08:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:08:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08d45d44-06c8-5777-ab82-d212449d4408/08d45d44-06c8-5777-ab82-d212449d4408_image_10.jpg HTTP/1.1" 201 0
2025-12-04 10:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F936490aa-3134-4728-b2c9-3885f9adf43f_ext_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/936490aa-3134-4728-b2c9-3885f9adf43f_ext_5.jpg saved to cache
2025-12-04 10:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 08d45d44-06c8-5777-ab82-d212449d4408
2025-12-04 10:08:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf58f10>
2025-12-04 10:08:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:08:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9200c31a-aec5-5dca-8036-0876fcfb70f2/9200c31a-aec5-5dca-8036-0876fcfb70f2_image_10.jpg HTTP/1.1" 201 0
2025-12-04 10:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4a84e7fd-e03b-494b-af2a-02ac1b2a19e4_ext_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4a84e7fd-e03b-494b-af2a-02ac1b2a19e4_ext_5.jpg saved to cache
2025-12-04 10:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 9200c31a-aec5-5dca-8036-0876fcfb70f2
2025-12-04 10:08:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf5b2d0>
2025-12-04 10:08:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:08:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08d45d44-06c8-5777-ab82-d212449d4408/08d45d44-06c8-5777-ab82-d212449d4408_image_9.jpg HTTP/1.1" 201 0
2025-12-04 10:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F936490aa-3134-4728-b2c9-3885f9adf43f_ext_2.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/936490aa-3134-4728-b2c9-3885f9adf43f_ext_2.jpg saved to cache
2025-12-04 10:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 08d45d44-06c8-5777-ab82-d212449d4408
2025-12-04 10:08:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc60a710>
2025-12-04 10:08:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:08:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9200c31a-aec5-5dca-8036-0876fcfb70f2/9200c31a-aec5-5dca-8036-0876fcfb70f2_image_9.jpg HTTP/1.1" 201 0
2025-12-04 10:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4a84e7fd-e03b-494b-af2a-02ac1b2a19e4_ext_2.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4a84e7fd-e03b-494b-af2a-02ac1b2a19e4_ext_2.jpg saved to cache
2025-12-04 10:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9200c31a-aec5-5dca-8036-0876fcfb70f2
2025-12-04 10:08:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccca4810>
2025-12-04 10:08:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:08:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9200c31a-aec5-5dca-8036-0876fcfb70f2/9200c31a-aec5-5dca-8036-0876fcfb70f2_image_8.jpg HTTP/1.1" 201 0
2025-12-04 10:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4a84e7fd-e03b-494b-af2a-02ac1b2a19e4_9.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4a84e7fd-e03b-494b-af2a-02ac1b2a19e4_9.jpg saved to cache
2025-12-04 10:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9200c31a-aec5-5dca-8036-0876fcfb70f2
2025-12-04 10:08:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/936490aa-3134-4728-b2c9-3885f9adf43f_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001761741-01991419-003.pdf)
2025-12-04 10:08:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/936490aa-3134-4728-b2c9-3885f9adf43f_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001761741-01991419-003.pdf)
2025-12-04 10:08:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4a84e7fd-e03b-494b-af2a-02ac1b2a19e4_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001564179-01991001-001.pdf)
2025-12-04 10:08:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/936490aa-3134-4728-b2c9-3885f9adf43f_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001761741-01991419-003.pdf)
2025-12-04 10:08:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4a84e7fd-e03b-494b-af2a-02ac1b2a19e4_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001564179-01991001-001.pdf)
2025-12-04 10:08:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4a84e7fd-e03b-494b-af2a-02ac1b2a19e4_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001564179-01991001-001.pdf)
2025-12-04 10:08:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4a84e7fd-e03b-494b-af2a-02ac1b2a19e4_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001564179-01991001-001.pdf)
2025-12-04 10:08:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf407d0>
2025-12-04 10:08:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:08:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08d45d44-06c8-5777-ab82-d212449d4408/08d45d44-06c8-5777-ab82-d212449d4408_image_7.jpg HTTP/1.1" 201 0
2025-12-04 10:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F936490aa-3134-4728-b2c9-3885f9adf43f_10.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/936490aa-3134-4728-b2c9-3885f9adf43f_10.jpg saved to cache
2025-12-04 10:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 08d45d44-06c8-5777-ab82-d212449d4408
2025-12-04 10:08:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003612695-01974152-004.pdf> (referer: None)
2025-12-04 10:08:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccc5ed90>
2025-12-04 10:08:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:08:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08d45d44-06c8-5777-ab82-d212449d4408/08d45d44-06c8-5777-ab82-d212449d4408_image_4.jpg HTTP/1.1" 201 0
2025-12-04 10:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F936490aa-3134-4728-b2c9-3885f9adf43f_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/936490aa-3134-4728-b2c9-3885f9adf43f_5.jpg saved to cache
2025-12-04 10:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 08d45d44-06c8-5777-ab82-d212449d4408
2025-12-04 10:08:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccfc2e50>
2025-12-04 10:08:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:08:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08d45d44-06c8-5777-ab82-d212449d4408/08d45d44-06c8-5777-ab82-d212449d4408_image_6.jpg HTTP/1.1" 201 0
2025-12-04 10:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F936490aa-3134-4728-b2c9-3885f9adf43f_11.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/936490aa-3134-4728-b2c9-3885f9adf43f_11.jpg saved to cache
2025-12-04 10:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 08d45d44-06c8-5777-ab82-d212449d4408
2025-12-04 10:08:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5caa90>
2025-12-04 10:08:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:08:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9200c31a-aec5-5dca-8036-0876fcfb70f2/9200c31a-aec5-5dca-8036-0876fcfb70f2_image_3.jpg HTTP/1.1" 201 0
2025-12-04 10:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4a84e7fd-e03b-494b-af2a-02ac1b2a19e4_ext_1.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4a84e7fd-e03b-494b-af2a-02ac1b2a19e4_ext_1.jpg saved to cache
2025-12-04 10:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9200c31a-aec5-5dca-8036-0876fcfb70f2
2025-12-04 10:08:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5cb0d0>
2025-12-04 10:08:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 10:08:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08d45d44-06c8-5777-ab82-d212449d4408/08d45d44-06c8-5777-ab82-d212449d4408_image_5.jpg HTTP/1.1" 201 0
2025-12-04 10:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F936490aa-3134-4728-b2c9-3885f9adf43f_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/936490aa-3134-4728-b2c9-3885f9adf43f_4.jpg saved to cache
2025-12-04 10:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 08d45d44-06c8-5777-ab82-d212449d4408
2025-12-04 10:08:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd091290>
2025-12-04 10:08:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:08:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9200c31a-aec5-5dca-8036-0876fcfb70f2/9200c31a-aec5-5dca-8036-0876fcfb70f2_image_6.jpg HTTP/1.1" 201 0
2025-12-04 10:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4a84e7fd-e03b-494b-af2a-02ac1b2a19e4_11.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4a84e7fd-e03b-494b-af2a-02ac1b2a19e4_11.jpg saved to cache
2025-12-04 10:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9200c31a-aec5-5dca-8036-0876fcfb70f2
2025-12-04 10:08:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6090d0>
2025-12-04 10:08:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:08:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9200c31a-aec5-5dca-8036-0876fcfb70f2/9200c31a-aec5-5dca-8036-0876fcfb70f2_image_4.jpg HTTP/1.1" 201 0
2025-12-04 10:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4a84e7fd-e03b-494b-af2a-02ac1b2a19e4_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4a84e7fd-e03b-494b-af2a-02ac1b2a19e4_5.jpg saved to cache
2025-12-04 10:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9200c31a-aec5-5dca-8036-0876fcfb70f2
2025-12-04 10:08:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5af510>
2025-12-04 10:08:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:08:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9200c31a-aec5-5dca-8036-0876fcfb70f2/9200c31a-aec5-5dca-8036-0876fcfb70f2_image_5.jpg HTTP/1.1" 201 0
2025-12-04 10:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4a84e7fd-e03b-494b-af2a-02ac1b2a19e4_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4a84e7fd-e03b-494b-af2a-02ac1b2a19e4_4.jpg saved to cache
2025-12-04 10:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9200c31a-aec5-5dca-8036-0876fcfb70f2
2025-12-04 10:08:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/936490aa-3134-4728-b2c9-3885f9adf43f_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001761741-01991419-003.pdf)
2025-12-04 10:08:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccec7190>
2025-12-04 10:08:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:08:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72aa258f-b6f1-589c-bbc5-46b8611b81de/72aa258f-b6f1-589c-bbc5-46b8611b81de_expert_report_file_abfcacb0-39c1-4966-89a3-e8710277b4c6.pdf HTTP/1.1" 201 0
2025-12-04 10:08:52 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 72aa258f-b6f1-589c-bbc5-46b8611b81de
2025-12-04 10:08:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 72aa258f-b6f1-589c-bbc5-46b8611b81de, skipping ID generation
2025-12-04 10:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 17 photos for item 72aa258f-b6f1-589c-bbc5-46b8611b81de
2025-12-04 10:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1cb85a0e-a40d-49eb-8e19-b5ce9aa98f86_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1cb85a0e-a40d-49eb-8e19-b5ce9aa98f86_ext_7.jpg not downloaded yet
2025-12-04 10:08:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/936490aa-3134-4728-b2c9-3885f9adf43f_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001761741-01991419-003.pdf)
2025-12-04 10:08:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/936490aa-3134-4728-b2c9-3885f9adf43f_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001761741-01991419-003.pdf)
2025-12-04 10:08:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4a84e7fd-e03b-494b-af2a-02ac1b2a19e4_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001564179-01991001-001.pdf)
2025-12-04 10:08:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2247450-4007658-1006.jpg> (referer: None)
2025-12-04 10:08:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4a84e7fd-e03b-494b-af2a-02ac1b2a19e4_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001564179-01991001-001.pdf)
2025-12-04 10:08:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4a84e7fd-e03b-494b-af2a-02ac1b2a19e4_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001564179-01991001-001.pdf)
2025-12-04 10:08:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/936490aa-3134-4728-b2c9-3885f9adf43f_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001761741-01991419-003.pdf)
2025-12-04 10:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1cb85a0e-a40d-49eb-8e19-b5ce9aa98f86_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1cb85a0e-a40d-49eb-8e19-b5ce9aa98f86_ext_7.jpg not downloaded yet
2025-12-04 10:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1cb85a0e-a40d-49eb-8e19-b5ce9aa98f86_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1cb85a0e-a40d-49eb-8e19-b5ce9aa98f86_ext_6.jpg not downloaded yet
2025-12-04 10:08:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2247450-4007658-1005.jpg> (referer: None)
2025-12-04 10:08:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd0d9110>
2025-12-04 10:08:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:08:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08d45d44-06c8-5777-ab82-d212449d4408/08d45d44-06c8-5777-ab82-d212449d4408_image_3.jpg HTTP/1.1" 201 0
2025-12-04 10:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F936490aa-3134-4728-b2c9-3885f9adf43f_ext_1.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/936490aa-3134-4728-b2c9-3885f9adf43f_ext_1.jpg saved to cache
2025-12-04 10:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 08d45d44-06c8-5777-ab82-d212449d4408
2025-12-04 10:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1cb85a0e-a40d-49eb-8e19-b5ce9aa98f86_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1cb85a0e-a40d-49eb-8e19-b5ce9aa98f86_ext_1.jpg not downloaded yet
2025-12-04 10:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1cb85a0e-a40d-49eb-8e19-b5ce9aa98f86_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1cb85a0e-a40d-49eb-8e19-b5ce9aa98f86_5.jpg not downloaded yet
2025-12-04 10:08:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2265358-4007656-1004.jpg> (referer: None)
2025-12-04 10:08:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2247450-4007658-1001.jpg> (referer: None)
2025-12-04 10:08:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2247450-4007658-1002.jpg> (referer: None)
2025-12-04 10:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1cb85a0e-a40d-49eb-8e19-b5ce9aa98f86_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1cb85a0e-a40d-49eb-8e19-b5ce9aa98f86_4.jpg not downloaded yet
2025-12-04 10:08:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc712650>
2025-12-04 10:08:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:08:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08d45d44-06c8-5777-ab82-d212449d4408/08d45d44-06c8-5777-ab82-d212449d4408_image_1.jpg HTTP/1.1" 201 0
2025-12-04 10:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F936490aa-3134-4728-b2c9-3885f9adf43f_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/936490aa-3134-4728-b2c9-3885f9adf43f_ext_7.jpg saved to cache
2025-12-04 10:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 08d45d44-06c8-5777-ab82-d212449d4408
2025-12-04 10:08:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd0341d0>
2025-12-04 10:08:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:08:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08d45d44-06c8-5777-ab82-d212449d4408/08d45d44-06c8-5777-ab82-d212449d4408_image_0.jpg HTTP/1.1" 201 0
2025-12-04 10:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F936490aa-3134-4728-b2c9-3885f9adf43f_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/936490aa-3134-4728-b2c9-3885f9adf43f_ext_7.jpg saved to cache
2025-12-04 10:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 08d45d44-06c8-5777-ab82-d212449d4408
2025-12-04 10:08:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd11c90>
2025-12-04 10:08:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:08:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9200c31a-aec5-5dca-8036-0876fcfb70f2/9200c31a-aec5-5dca-8036-0876fcfb70f2_image_1.jpg HTTP/1.1" 201 0
2025-12-04 10:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4a84e7fd-e03b-494b-af2a-02ac1b2a19e4_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4a84e7fd-e03b-494b-af2a-02ac1b2a19e4_ext_7.jpg saved to cache
2025-12-04 10:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9200c31a-aec5-5dca-8036-0876fcfb70f2
2025-12-04 10:08:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5922d0>
2025-12-04 10:08:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:08:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02f86a59-5d45-5bc0-a6cd-8af80f1a5c13/02f86a59-5d45-5bc0-a6cd-8af80f1a5c13_image_19.jpg HTTP/1.1" 201 0
2025-12-04 10:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2247450-4007658-1006.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2247450-4007658-1006.jpg saved to cache
2025-12-04 10:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 02f86a59-5d45-5bc0-a6cd-8af80f1a5c13
2025-12-04 10:08:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc711090>
2025-12-04 10:08:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:08:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9200c31a-aec5-5dca-8036-0876fcfb70f2/9200c31a-aec5-5dca-8036-0876fcfb70f2_image_0.jpg HTTP/1.1" 201 0
2025-12-04 10:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4a84e7fd-e03b-494b-af2a-02ac1b2a19e4_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4a84e7fd-e03b-494b-af2a-02ac1b2a19e4_ext_7.jpg saved to cache
2025-12-04 10:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9200c31a-aec5-5dca-8036-0876fcfb70f2
2025-12-04 10:08:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd0ca790>
2025-12-04 10:08:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:08:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9200c31a-aec5-5dca-8036-0876fcfb70f2/9200c31a-aec5-5dca-8036-0876fcfb70f2_image_2.jpg HTTP/1.1" 201 0
2025-12-04 10:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4a84e7fd-e03b-494b-af2a-02ac1b2a19e4_ext_6.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4a84e7fd-e03b-494b-af2a-02ac1b2a19e4_ext_6.jpg saved to cache
2025-12-04 10:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9200c31a-aec5-5dca-8036-0876fcfb70f2
2025-12-04 10:08:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9200c31a-aec5-5dca-8036-0876fcfb70f2, skipping ID generation
2025-12-04 10:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 9200c31a-aec5-5dca-8036-0876fcfb70f2 from tracking dictionaries
2025-12-04 10:08:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9200c31a-aec5-5dca-8036-0876fcfb70f2 sending to next pipeline
2025-12-04 10:08:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 9200c31a-aec5-5dca-8036-0876fcfb70f2, identifier: 1564179
2025-12-04 10:08:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc72ff50>
2025-12-04 10:08:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:08:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08d45d44-06c8-5777-ab82-d212449d4408/08d45d44-06c8-5777-ab82-d212449d4408_image_2.jpg HTTP/1.1" 201 0
2025-12-04 10:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F936490aa-3134-4728-b2c9-3885f9adf43f_ext_6.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/936490aa-3134-4728-b2c9-3885f9adf43f_ext_6.jpg saved to cache
2025-12-04 10:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 08d45d44-06c8-5777-ab82-d212449d4408
2025-12-04 10:08:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 08d45d44-06c8-5777-ab82-d212449d4408, skipping ID generation
2025-12-04 10:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 08d45d44-06c8-5777-ab82-d212449d4408 from tracking dictionaries
2025-12-04 10:08:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 08d45d44-06c8-5777-ab82-d212449d4408 sending to next pipeline
2025-12-04 10:08:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 08d45d44-06c8-5777-ab82-d212449d4408, identifier: 1761741
2025-12-04 10:08:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccdf6190>
2025-12-04 10:08:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:08:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02f86a59-5d45-5bc0-a6cd-8af80f1a5c13/02f86a59-5d45-5bc0-a6cd-8af80f1a5c13_image_18.jpg HTTP/1.1" 201 0
2025-12-04 10:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2247450-4007658-1005.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2247450-4007658-1005.jpg saved to cache
2025-12-04 10:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 02f86a59-5d45-5bc0-a6cd-8af80f1a5c13
2025-12-04 10:08:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 9200c31a-aec5-5dca-8036-0876fcfb70f2 with identifier: 1564179
2025-12-04 10:08:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 9200c31a-aec5-5dca-8036-0876fcfb70f2 with identifier: 1564179
2025-12-04 10:08:56 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 12 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    12
2025-12-04 10:08:56 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: 9200c31a-aec5-5dca-8036-0876fcfb70f2 spider: manheim.gb
2025-12-04 10:08:56 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 9200c31a-aec5-5dca-8036-0876fcfb70f2 due to rule: registration_date_old.json, error: 12 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    12
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9200c31a-aec5-5dca-8036-0876fcfb70f2/9200c31a-aec5-5dca-8036-0876fcfb70f2_expert_report_file_45baa790-0d2d-4f2b-bc40-21212933f239.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001564179-01991001-001.pdf',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '1.4L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '9200c31a-aec5-5dca-8036-0876fcfb70f2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'YF13FKO',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/HYUNDAI/IX20?id=1564179',
 'listing': 'auction',
 'location': 'Leeds',
 'make': 'HYUNDAI',
 'model': 'IX20',
 'odometer': 66794,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 24,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9200c31a-aec5-5dca-8036-0876fcfb70f2/9200c31a-aec5-5dca-8036-0876fcfb70f2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 217869,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4a84e7fd-e03b-494b-af2a-02ac1b2a19e4_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9200c31a-aec5-5dca-8036-0876fcfb70f2/9200c31a-aec5-5dca-8036-0876fcfb70f2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 217869,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4a84e7fd-e03b-494b-af2a-02ac1b2a19e4_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9200c31a-aec5-5dca-8036-0876fcfb70f2/9200c31a-aec5-5dca-8036-0876fcfb70f2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 214867,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4a84e7fd-e03b-494b-af2a-02ac1b2a19e4_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9200c31a-aec5-5dca-8036-0876fcfb70f2/9200c31a-aec5-5dca-8036-0876fcfb70f2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 192036,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4a84e7fd-e03b-494b-af2a-02ac1b2a19e4_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9200c31a-aec5-5dca-8036-0876fcfb70f2/9200c31a-aec5-5dca-8036-0876fcfb70f2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 209001,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4a84e7fd-e03b-494b-af2a-02ac1b2a19e4_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9200c31a-aec5-5dca-8036-0876fcfb70f2/9200c31a-aec5-5dca-8036-0876fcfb70f2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 196674,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4a84e7fd-e03b-494b-af2a-02ac1b2a19e4_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9200c31a-aec5-5dca-8036-0876fcfb70f2/9200c31a-aec5-5dca-8036-0876fcfb70f2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 199952,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4a84e7fd-e03b-494b-af2a-02ac1b2a19e4_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9200c31a-aec5-5dca-8036-0876fcfb70f2/9200c31a-aec5-5dca-8036-0876fcfb70f2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 176797,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4a84e7fd-e03b-494b-af2a-02ac1b2a19e4_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9200c31a-aec5-5dca-8036-0876fcfb70f2/9200c31a-aec5-5dca-8036-0876fcfb70f2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 203243,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4a84e7fd-e03b-494b-af2a-02ac1b2a19e4_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9200c31a-aec5-5dca-8036-0876fcfb70f2/9200c31a-aec5-5dca-8036-0876fcfb70f2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 233967,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4a84e7fd-e03b-494b-af2a-02ac1b2a19e4_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9200c31a-aec5-5dca-8036-0876fcfb70f2/9200c31a-aec5-5dca-8036-0876fcfb70f2_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 199046,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4a84e7fd-e03b-494b-af2a-02ac1b2a19e4_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9200c31a-aec5-5dca-8036-0876fcfb70f2/9200c31a-aec5-5dca-8036-0876fcfb70f2_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 190683,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4a84e7fd-e03b-494b-af2a-02ac1b2a19e4_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9200c31a-aec5-5dca-8036-0876fcfb70f2/9200c31a-aec5-5dca-8036-0876fcfb70f2_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 239561,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4a84e7fd-e03b-494b-af2a-02ac1b2a19e4_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9200c31a-aec5-5dca-8036-0876fcfb70f2/9200c31a-aec5-5dca-8036-0876fcfb70f2_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 316543,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1564179-4007572-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9200c31a-aec5-5dca-8036-0876fcfb70f2/9200c31a-aec5-5dca-8036-0876fcfb70f2_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 147440,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1564179-4007572-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9200c31a-aec5-5dca-8036-0876fcfb70f2/9200c31a-aec5-5dca-8036-0876fcfb70f2_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108071,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1564179-4007572-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9200c31a-aec5-5dca-8036-0876fcfb70f2/9200c31a-aec5-5dca-8036-0876fcfb70f2_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 271248,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1564179-4007572-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9200c31a-aec5-5dca-8036-0876fcfb70f2/9200c31a-aec5-5dca-8036-0876fcfb70f2_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98417,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1564179-4007572-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9200c31a-aec5-5dca-8036-0876fcfb70f2/9200c31a-aec5-5dca-8036-0876fcfb70f2_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 190580,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1564179-4007572-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9200c31a-aec5-5dca-8036-0876fcfb70f2/9200c31a-aec5-5dca-8036-0876fcfb70f2_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 217922,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1564179-4007572-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-26',
 'seller_name': 'Big Motoring World Ltd',
 'title': 'HYUNDAI IX20 1.4 Active 5dr',
 'transmission': 'manual',
 'trim': '1.4 Active 5dr',
 'year': 2013}
2025-12-04 10:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271564179%27 HTTP/1.1" 200 None
2025-12-04 10:08:56 [manheim.gb] INFO: Saving data for 1564179: {'created_time': 1764842936.139761, 'last_price_update_time': 1764842936.13977, 'auction_closing_time': 1765184400.0}
2025-12-04 10:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1564179') HTTP/1.1" 204 0
2025-12-04 10:08:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 08d45d44-06c8-5777-ab82-d212449d4408 with identifier: 1761741
2025-12-04 10:08:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 08d45d44-06c8-5777-ab82-d212449d4408 with identifier: 1761741
2025-12-04 10:08:56 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 10 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    10
2025-12-04 10:08:56 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: 08d45d44-06c8-5777-ab82-d212449d4408 spider: manheim.gb
2025-12-04 10:08:56 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 08d45d44-06c8-5777-ab82-d212449d4408 due to rule: registration_date_old.json, error: 10 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    10
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08d45d44-06c8-5777-ab82-d212449d4408/08d45d44-06c8-5777-ab82-d212449d4408_expert_report_file_a230b9e9-76af-4837-9451-581cd87af006.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001761741-01991419-003.pdf',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '1.5L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '08d45d44-06c8-5777-ab82-d212449d4408',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'LO65XUG',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/BMW/1%20SERIES?id=1761741',
 'listing': 'auction',
 'location': 'Manchester',
 'make': 'BMW',
 'model': '1 SERIES',
 'odometer': 89771,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 32,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08d45d44-06c8-5777-ab82-d212449d4408/08d45d44-06c8-5777-ab82-d212449d4408_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 171775,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/936490aa-3134-4728-b2c9-3885f9adf43f_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08d45d44-06c8-5777-ab82-d212449d4408/08d45d44-06c8-5777-ab82-d212449d4408_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 171775,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/936490aa-3134-4728-b2c9-3885f9adf43f_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08d45d44-06c8-5777-ab82-d212449d4408/08d45d44-06c8-5777-ab82-d212449d4408_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 252348,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/936490aa-3134-4728-b2c9-3885f9adf43f_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08d45d44-06c8-5777-ab82-d212449d4408/08d45d44-06c8-5777-ab82-d212449d4408_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 200135,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/936490aa-3134-4728-b2c9-3885f9adf43f_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08d45d44-06c8-5777-ab82-d212449d4408/08d45d44-06c8-5777-ab82-d212449d4408_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 180002,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/936490aa-3134-4728-b2c9-3885f9adf43f_5.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08d45d44-06c8-5777-ab82-d212449d4408/08d45d44-06c8-5777-ab82-d212449d4408_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 172172,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/936490aa-3134-4728-b2c9-3885f9adf43f_4.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08d45d44-06c8-5777-ab82-d212449d4408/08d45d44-06c8-5777-ab82-d212449d4408_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 181655,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/936490aa-3134-4728-b2c9-3885f9adf43f_11.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08d45d44-06c8-5777-ab82-d212449d4408/08d45d44-06c8-5777-ab82-d212449d4408_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 176085,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/936490aa-3134-4728-b2c9-3885f9adf43f_10.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08d45d44-06c8-5777-ab82-d212449d4408/08d45d44-06c8-5777-ab82-d212449d4408_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 180244,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/936490aa-3134-4728-b2c9-3885f9adf43f_9.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08d45d44-06c8-5777-ab82-d212449d4408/08d45d44-06c8-5777-ab82-d212449d4408_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 245268,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/936490aa-3134-4728-b2c9-3885f9adf43f_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08d45d44-06c8-5777-ab82-d212449d4408/08d45d44-06c8-5777-ab82-d212449d4408_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 202880,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/936490aa-3134-4728-b2c9-3885f9adf43f_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08d45d44-06c8-5777-ab82-d212449d4408/08d45d44-06c8-5777-ab82-d212449d4408_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 157559,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/936490aa-3134-4728-b2c9-3885f9adf43f_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08d45d44-06c8-5777-ab82-d212449d4408/08d45d44-06c8-5777-ab82-d212449d4408_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 197240,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/936490aa-3134-4728-b2c9-3885f9adf43f_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08d45d44-06c8-5777-ab82-d212449d4408/08d45d44-06c8-5777-ab82-d212449d4408_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 311116,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1761741-4007528-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08d45d44-06c8-5777-ab82-d212449d4408/08d45d44-06c8-5777-ab82-d212449d4408_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 365427,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1761741-4007528-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08d45d44-06c8-5777-ab82-d212449d4408/08d45d44-06c8-5777-ab82-d212449d4408_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 328009,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1761741-4007528-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08d45d44-06c8-5777-ab82-d212449d4408/08d45d44-06c8-5777-ab82-d212449d4408_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 290629,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1761741-4007528-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08d45d44-06c8-5777-ab82-d212449d4408/08d45d44-06c8-5777-ab82-d212449d4408_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 371987,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1761741-4007528-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08d45d44-06c8-5777-ab82-d212449d4408/08d45d44-06c8-5777-ab82-d212449d4408_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 298698,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1761741-4007528-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08d45d44-06c8-5777-ab82-d212449d4408/08d45d44-06c8-5777-ab82-d212449d4408_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 286497,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1761741-4007528-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-31',
 'seller_name': 'Swansway Garages',
 'title': 'BMW 1 SERIES 118i [1.5] M Sport 5dr',
 'transmission': 'manual',
 'trim': '118i [1.5] M Sport 5dr',
 'year': 2015}
2025-12-04 10:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271761741%27 HTTP/1.1" 200 None
2025-12-04 10:08:56 [manheim.gb] INFO: Saving data for 1761741: {'created_time': 1764842936.400448, 'last_price_update_time': 1764842936.400457, 'auction_closing_time': 1765270800.0}
2025-12-04 10:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1761741') HTTP/1.1" 204 0
2025-12-04 10:08:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2247450-4007658-1003.jpg> (referer: None)
2025-12-04 10:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1cb85a0e-a40d-49eb-8e19-b5ce9aa98f86_11.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1cb85a0e-a40d-49eb-8e19-b5ce9aa98f86_11.jpg not downloaded yet
2025-12-04 10:08:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2247450-4007658-13.jpg> (referer: None)
2025-12-04 10:08:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2247450-4007658-1004.jpg> (referer: None)
2025-12-04 10:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1cb85a0e-a40d-49eb-8e19-b5ce9aa98f86_10.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1cb85a0e-a40d-49eb-8e19-b5ce9aa98f86_10.jpg not downloaded yet
2025-12-04 10:08:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1cb85a0e-a40d-49eb-8e19-b5ce9aa98f86_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003612695-01974152-004.pdf)
2025-12-04 10:08:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1cb85a0e-a40d-49eb-8e19-b5ce9aa98f86_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003612695-01974152-004.pdf)
2025-12-04 10:08:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1cb85a0e-a40d-49eb-8e19-b5ce9aa98f86_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003612695-01974152-004.pdf)
2025-12-04 10:08:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf90c10>
2025-12-04 10:08:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:08:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b102101-564b-564d-8986-4da408ea4b0f/5b102101-564b-564d-8986-4da408ea4b0f_image_8.jpg HTTP/1.1" 201 0
2025-12-04 10:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2265358-4007656-1004.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2265358-4007656-1004.jpg saved to cache
2025-12-04 10:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5b102101-564b-564d-8986-4da408ea4b0f
2025-12-04 10:08:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc595010>
2025-12-04 10:08:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:08:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02f86a59-5d45-5bc0-a6cd-8af80f1a5c13/02f86a59-5d45-5bc0-a6cd-8af80f1a5c13_image_14.jpg HTTP/1.1" 201 0
2025-12-04 10:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2247450-4007658-1001.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2247450-4007658-1001.jpg saved to cache
2025-12-04 10:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 02f86a59-5d45-5bc0-a6cd-8af80f1a5c13
2025-12-04 10:08:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc602210>
2025-12-04 10:08:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:08:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02f86a59-5d45-5bc0-a6cd-8af80f1a5c13/02f86a59-5d45-5bc0-a6cd-8af80f1a5c13_image_15.jpg HTTP/1.1" 201 0
2025-12-04 10:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2247450-4007658-1002.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2247450-4007658-1002.jpg saved to cache
2025-12-04 10:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 02f86a59-5d45-5bc0-a6cd-8af80f1a5c13
2025-12-04 10:08:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1cb85a0e-a40d-49eb-8e19-b5ce9aa98f86_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003612695-01974152-004.pdf)
2025-12-04 10:08:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1cb85a0e-a40d-49eb-8e19-b5ce9aa98f86_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003612695-01974152-004.pdf)
2025-12-04 10:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1cb85a0e-a40d-49eb-8e19-b5ce9aa98f86_9.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1cb85a0e-a40d-49eb-8e19-b5ce9aa98f86_9.jpg not downloaded yet
2025-12-04 10:08:57 [scrapy.core.engine] DEBUG: Crawled (404) <GET http://images.manheim.co.uk/images/units/zoom/2247450-9999999-344103512-011.jpg> (referer: None)
2025-12-04 10:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1cb85a0e-a40d-49eb-8e19-b5ce9aa98f86_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1cb85a0e-a40d-49eb-8e19-b5ce9aa98f86_ext_2.jpg not downloaded yet
2025-12-04 10:08:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc69b8d0>
2025-12-04 10:08:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:08:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02f86a59-5d45-5bc0-a6cd-8af80f1a5c13/02f86a59-5d45-5bc0-a6cd-8af80f1a5c13_image_16.jpg HTTP/1.1" 201 0
2025-12-04 10:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2247450-4007658-1003.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2247450-4007658-1003.jpg saved to cache
2025-12-04 10:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 02f86a59-5d45-5bc0-a6cd-8af80f1a5c13
2025-12-04 10:08:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce026d0>
2025-12-04 10:08:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:08:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02f86a59-5d45-5bc0-a6cd-8af80f1a5c13/02f86a59-5d45-5bc0-a6cd-8af80f1a5c13_image_12.jpg HTTP/1.1" 201 0
2025-12-04 10:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2247450-4007658-13.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2247450-4007658-13.jpg saved to cache
2025-12-04 10:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 02f86a59-5d45-5bc0-a6cd-8af80f1a5c13
2025-12-04 10:08:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc56fd50>
2025-12-04 10:08:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:08:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02f86a59-5d45-5bc0-a6cd-8af80f1a5c13/02f86a59-5d45-5bc0-a6cd-8af80f1a5c13_image_17.jpg HTTP/1.1" 201 0
2025-12-04 10:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2247450-4007658-1004.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2247450-4007658-1004.jpg saved to cache
2025-12-04 10:08:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 02f86a59-5d45-5bc0-a6cd-8af80f1a5c13
2025-12-04 10:08:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf93fd0>
2025-12-04 10:08:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:08:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72aa258f-b6f1-589c-bbc5-46b8611b81de/72aa258f-b6f1-589c-bbc5-46b8611b81de_image_0.jpg HTTP/1.1" 201 0
2025-12-04 10:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1cb85a0e-a40d-49eb-8e19-b5ce9aa98f86_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1cb85a0e-a40d-49eb-8e19-b5ce9aa98f86_ext_7.jpg saved to cache
2025-12-04 10:08:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 72aa258f-b6f1-589c-bbc5-46b8611b81de
2025-12-04 10:08:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5f5a10>
2025-12-04 10:08:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:08:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72aa258f-b6f1-589c-bbc5-46b8611b81de/72aa258f-b6f1-589c-bbc5-46b8611b81de_image_1.jpg HTTP/1.1" 201 0
2025-12-04 10:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1cb85a0e-a40d-49eb-8e19-b5ce9aa98f86_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1cb85a0e-a40d-49eb-8e19-b5ce9aa98f86_ext_7.jpg saved to cache
2025-12-04 10:08:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 72aa258f-b6f1-589c-bbc5-46b8611b81de
2025-12-04 10:08:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6d9010>
2025-12-04 10:08:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:08:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72aa258f-b6f1-589c-bbc5-46b8611b81de/72aa258f-b6f1-589c-bbc5-46b8611b81de_image_3.jpg HTTP/1.1" 201 0
2025-12-04 10:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1cb85a0e-a40d-49eb-8e19-b5ce9aa98f86_ext_1.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1cb85a0e-a40d-49eb-8e19-b5ce9aa98f86_ext_1.jpg saved to cache
2025-12-04 10:08:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 72aa258f-b6f1-589c-bbc5-46b8611b81de
2025-12-04 10:08:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1cb85a0e-a40d-49eb-8e19-b5ce9aa98f86_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003612695-01974152-004.pdf)
2025-12-04 10:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1cb85a0e-a40d-49eb-8e19-b5ce9aa98f86_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1cb85a0e-a40d-49eb-8e19-b5ce9aa98f86_ext_5.jpg not downloaded yet
2025-12-04 10:08:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd104490>
2025-12-04 10:08:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:08:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72aa258f-b6f1-589c-bbc5-46b8611b81de/72aa258f-b6f1-589c-bbc5-46b8611b81de_image_2.jpg HTTP/1.1" 201 0
2025-12-04 10:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1cb85a0e-a40d-49eb-8e19-b5ce9aa98f86_ext_6.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1cb85a0e-a40d-49eb-8e19-b5ce9aa98f86_ext_6.jpg saved to cache
2025-12-04 10:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 72aa258f-b6f1-589c-bbc5-46b8611b81de
2025-12-04 10:08:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccfcec10>
2025-12-04 10:08:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:08:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:08:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:08:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:08:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:08:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72aa258f-b6f1-589c-bbc5-46b8611b81de/72aa258f-b6f1-589c-bbc5-46b8611b81de_image_4.jpg HTTP/1.1" 201 0
2025-12-04 10:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1cb85a0e-a40d-49eb-8e19-b5ce9aa98f86_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1cb85a0e-a40d-49eb-8e19-b5ce9aa98f86_5.jpg saved to cache
2025-12-04 10:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 72aa258f-b6f1-589c-bbc5-46b8611b81de
2025-12-04 10:08:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 02f86a59-5d45-5bc0-a6cd-8af80f1a5c13, skipping ID generation
2025-12-04 10:08:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02f86a59-5d45-5bc0-a6cd-8af80f1a5c13 with scrape type 1
2025-12-04 10:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 02f86a59-5d45-5bc0-a6cd-8af80f1a5c13 from tracking dictionaries
2025-12-04 10:08:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 02f86a59-5d45-5bc0-a6cd-8af80f1a5c13 sending to next pipeline
2025-12-04 10:08:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 02f86a59-5d45-5bc0-a6cd-8af80f1a5c13, identifier: 2247450
2025-12-04 10:08:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2265358-4007656-1001.jpg> (referer: None)
2025-12-04 10:08:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1cb85a0e-a40d-49eb-8e19-b5ce9aa98f86_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003612695-01974152-004.pdf)
2025-12-04 10:08:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1cb85a0e-a40d-49eb-8e19-b5ce9aa98f86_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003612695-01974152-004.pdf)
2025-12-04 10:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1cb85a0e-a40d-49eb-8e19-b5ce9aa98f86_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1cb85a0e-a40d-49eb-8e19-b5ce9aa98f86_ext_3.jpg not downloaded yet
2025-12-04 10:08:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 02f86a59-5d45-5bc0-a6cd-8af80f1a5c13 with identifier: 2247450
2025-12-04 10:08:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 02f86a59-5d45-5bc0-a6cd-8af80f1a5c13 with identifier: 2247450
2025-12-04 10:08:59 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 15 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    15
2025-12-04 10:08:59 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: 02f86a59-5d45-5bc0-a6cd-8af80f1a5c13 spider: manheim.gb
2025-12-04 10:08:59 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 02f86a59-5d45-5bc0-a6cd-8af80f1a5c13 due to rule: registration_date_old.json, error: 15 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    15
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'car_expert_report_source_url': None,
 'color': 'ORANGE',
 'currency': 'GBP',
 'engine': '1.3L',
 'expiration_date': '2025-12-10T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '02f86a59-5d45-5bc0-a6cd-8af80f1a5c13',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'YG10UMO',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MAZDA/2?id=2247450',
 'listing': 'auction',
 'location': 'Birmingham',
 'make': 'MAZDA',
 'model': '2',
 'odometer': 78977,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 44,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02f86a59-5d45-5bc0-a6cd-8af80f1a5c13/02f86a59-5d45-5bc0-a6cd-8af80f1a5c13_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 415212,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2247450-4007658-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02f86a59-5d45-5bc0-a6cd-8af80f1a5c13/02f86a59-5d45-5bc0-a6cd-8af80f1a5c13_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 235869,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2247450-4007658-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02f86a59-5d45-5bc0-a6cd-8af80f1a5c13/02f86a59-5d45-5bc0-a6cd-8af80f1a5c13_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 213232,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2247450-4007658-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02f86a59-5d45-5bc0-a6cd-8af80f1a5c13/02f86a59-5d45-5bc0-a6cd-8af80f1a5c13_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 244645,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2247450-4007658-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02f86a59-5d45-5bc0-a6cd-8af80f1a5c13/02f86a59-5d45-5bc0-a6cd-8af80f1a5c13_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 253025,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2247450-4007658-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02f86a59-5d45-5bc0-a6cd-8af80f1a5c13/02f86a59-5d45-5bc0-a6cd-8af80f1a5c13_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 255776,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2247450-4007658-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02f86a59-5d45-5bc0-a6cd-8af80f1a5c13/02f86a59-5d45-5bc0-a6cd-8af80f1a5c13_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 215730,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2247450-4007658-1005.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02f86a59-5d45-5bc0-a6cd-8af80f1a5c13/02f86a59-5d45-5bc0-a6cd-8af80f1a5c13_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 246602,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2247450-4007658-1006.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-04-30',
 'seller_name': 'Available Car',
 'title': 'MAZDA 2 1.3 TS2 5dr',
 'transmission': 'manual',
 'trim': '1.3 TS2 5dr',
 'year': 2010}
2025-12-04 10:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272247450%27 HTTP/1.1" 200 None
2025-12-04 10:08:59 [manheim.gb] INFO: Saving data for 2247450: {'created_time': 1764842939.917414, 'last_price_update_time': 1764842939.917425, 'auction_closing_time': 1765357200.0}
2025-12-04 10:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2247450') HTTP/1.1" 204 0
2025-12-04 10:08:59 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 10 for item 02f86a59-5d45-5bc0-a6cd-8af80f1a5c13 due to Ignoring non-200 response
2025-12-04 10:08:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2265358-4007656-1000.jpg> (referer: None)
2025-12-04 10:08:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2265358-4007656-13.jpg> (referer: None)
2025-12-04 10:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1cb85a0e-a40d-49eb-8e19-b5ce9aa98f86_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1cb85a0e-a40d-49eb-8e19-b5ce9aa98f86_ext_4.jpg not downloaded yet
2025-12-04 10:08:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:08:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:08:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:08:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd0c3610>
2025-12-04 10:08:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:08:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:09:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72aa258f-b6f1-589c-bbc5-46b8611b81de/72aa258f-b6f1-589c-bbc5-46b8611b81de_image_5.jpg HTTP/1.1" 201 0
2025-12-04 10:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1cb85a0e-a40d-49eb-8e19-b5ce9aa98f86_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1cb85a0e-a40d-49eb-8e19-b5ce9aa98f86_4.jpg saved to cache
2025-12-04 10:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 72aa258f-b6f1-589c-bbc5-46b8611b81de
2025-12-04 10:09:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1cb85a0e-a40d-49eb-8e19-b5ce9aa98f86_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003612695-01974152-004.pdf)
2025-12-04 10:09:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1cb85a0e-a40d-49eb-8e19-b5ce9aa98f86_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003612695-01974152-004.pdf)
2025-12-04 10:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3612695-3993592-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3612695-3993592-13.jpg not downloaded yet
2025-12-04 10:09:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc57ab90>
2025-12-04 10:09:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:09:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b102101-564b-564d-8986-4da408ea4b0f/5b102101-564b-564d-8986-4da408ea4b0f_image_5.jpg HTTP/1.1" 201 0
2025-12-04 10:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2265358-4007656-1001.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2265358-4007656-1001.jpg saved to cache
2025-12-04 10:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5b102101-564b-564d-8986-4da408ea4b0f
2025-12-04 10:09:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccfae950>
2025-12-04 10:09:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:09:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72aa258f-b6f1-589c-bbc5-46b8611b81de/72aa258f-b6f1-589c-bbc5-46b8611b81de_image_6.jpg HTTP/1.1" 201 0
2025-12-04 10:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1cb85a0e-a40d-49eb-8e19-b5ce9aa98f86_11.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1cb85a0e-a40d-49eb-8e19-b5ce9aa98f86_11.jpg saved to cache
2025-12-04 10:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 72aa258f-b6f1-589c-bbc5-46b8611b81de
2025-12-04 10:09:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce90310>
2025-12-04 10:09:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:09:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72aa258f-b6f1-589c-bbc5-46b8611b81de/72aa258f-b6f1-589c-bbc5-46b8611b81de_image_7.jpg HTTP/1.1" 201 0
2025-12-04 10:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1cb85a0e-a40d-49eb-8e19-b5ce9aa98f86_10.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1cb85a0e-a40d-49eb-8e19-b5ce9aa98f86_10.jpg saved to cache
2025-12-04 10:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 72aa258f-b6f1-589c-bbc5-46b8611b81de
2025-12-04 10:09:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1cb85a0e-a40d-49eb-8e19-b5ce9aa98f86_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003612695-01974152-004.pdf)
2025-12-04 10:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3612695-3993592-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3612695-3993592-1000.jpg not downloaded yet
2025-12-04 10:09:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd0c25d0>
2025-12-04 10:09:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:09:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b102101-564b-564d-8986-4da408ea4b0f/5b102101-564b-564d-8986-4da408ea4b0f_image_4.jpg HTTP/1.1" 201 0
2025-12-04 10:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2265358-4007656-1000.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2265358-4007656-1000.jpg saved to cache
2025-12-04 10:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5b102101-564b-564d-8986-4da408ea4b0f
2025-12-04 10:09:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cccd0850>
2025-12-04 10:09:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:09:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b102101-564b-564d-8986-4da408ea4b0f/5b102101-564b-564d-8986-4da408ea4b0f_image_3.jpg HTTP/1.1" 201 0
2025-12-04 10:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2265358-4007656-13.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2265358-4007656-13.jpg saved to cache
2025-12-04 10:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5b102101-564b-564d-8986-4da408ea4b0f
2025-12-04 10:09:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5b102101-564b-564d-8986-4da408ea4b0f, skipping ID generation
2025-12-04 10:09:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b102101-564b-564d-8986-4da408ea4b0f with scrape type 1
2025-12-04 10:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 5b102101-564b-564d-8986-4da408ea4b0f from tracking dictionaries
2025-12-04 10:09:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5b102101-564b-564d-8986-4da408ea4b0f sending to next pipeline
2025-12-04 10:09:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 5b102101-564b-564d-8986-4da408ea4b0f, identifier: 2265358
2025-12-04 10:09:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 5b102101-564b-564d-8986-4da408ea4b0f with identifier: 2265358
2025-12-04 10:09:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 5b102101-564b-564d-8986-4da408ea4b0f with identifier: 2265358
2025-12-04 10:09:02 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 5b102101-564b-564d-8986-4da408ea4b0f with identifier: 2265358 to the API
2025-12-04 10:09:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 10:09:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 10:09:02 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/insp-0001-2265358-4007656-13.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'car_expert_report_source_url': None,
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '5b102101-564b-564d-8986-4da408ea4b0f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'GU67FWR',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VOLVO/S90?id=2265358',
 'listing': 'auction',
 'location': 'Northampton',
 'make': 'VOLVO',
 'model': 'S90',
 'odometer': 87504,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4622c3ba-5515-5758-814e-2f49e4247fa1/4622c3ba-5515-5758-814e-2f49e4247fa1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72484,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/awaiting-image-002.jpg',
             'Width': 1322},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4622c3ba-5515-5758-814e-2f49e4247fa1/4622c3ba-5515-5758-814e-2f49e4247fa1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72484,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/awaiting-image-002.jpg',
             'Width': 1322},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b102101-564b-564d-8986-4da408ea4b0f/5b102101-564b-564d-8986-4da408ea4b0f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 171948,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2265358-4007656-3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b102101-564b-564d-8986-4da408ea4b0f/5b102101-564b-564d-8986-4da408ea4b0f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 291229,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2265358-4007656-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b102101-564b-564d-8986-4da408ea4b0f/5b102101-564b-564d-8986-4da408ea4b0f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 319267,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2265358-4007656-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b102101-564b-564d-8986-4da408ea4b0f/5b102101-564b-564d-8986-4da408ea4b0f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 351844,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2265358-4007656-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b102101-564b-564d-8986-4da408ea4b0f/5b102101-564b-564d-8986-4da408ea4b0f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 317366,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2265358-4007656-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b102101-564b-564d-8986-4da408ea4b0f/5b102101-564b-564d-8986-4da408ea4b0f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 260309,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2265358-4007656-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b102101-564b-564d-8986-4da408ea4b0f/5b102101-564b-564d-8986-4da408ea4b0f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 167874,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2265358-4007656-1004.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-16',
 'seller_name': 'Wollaston',
 'title': 'VOLVO S90 2.0 D4 R DESIGN 4dr Geartronic',
 'transmission': 'automatic',
 'trim': '2.0 D4 R DESIGN 4dr Geartronic',
 'year': 2018}
2025-12-04 10:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272265358%27 HTTP/1.1" 200 None
2025-12-04 10:09:02 [manheim.gb] INFO: Saving data for 2265358: {'created_time': 1764842942.363026, 'last_price_update_time': 1764842942.363035, 'auction_closing_time': 1765270800.0}
2025-12-04 10:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2265358') HTTP/1.1" 204 0
2025-12-04 10:09:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ce624dd0>
2025-12-04 10:09:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:09:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72aa258f-b6f1-589c-bbc5-46b8611b81de/72aa258f-b6f1-589c-bbc5-46b8611b81de_image_8.jpg HTTP/1.1" 201 0
2025-12-04 10:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1cb85a0e-a40d-49eb-8e19-b5ce9aa98f86_9.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1cb85a0e-a40d-49eb-8e19-b5ce9aa98f86_9.jpg saved to cache
2025-12-04 10:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 72aa258f-b6f1-589c-bbc5-46b8611b81de
2025-12-04 10:09:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd83cd0>
2025-12-04 10:09:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:09:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72aa258f-b6f1-589c-bbc5-46b8611b81de/72aa258f-b6f1-589c-bbc5-46b8611b81de_image_9.jpg HTTP/1.1" 201 0
2025-12-04 10:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1cb85a0e-a40d-49eb-8e19-b5ce9aa98f86_ext_2.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1cb85a0e-a40d-49eb-8e19-b5ce9aa98f86_ext_2.jpg saved to cache
2025-12-04 10:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 72aa258f-b6f1-589c-bbc5-46b8611b81de
2025-12-04 10:09:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0000233754-01989638-001.pdf> (referer: None)
2025-12-04 10:09:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1cb85a0e-a40d-49eb-8e19-b5ce9aa98f86_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003612695-01974152-004.pdf)
2025-12-04 10:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3612695-3993592-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3612695-3993592-1001.jpg not downloaded yet
2025-12-04 10:09:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf9f7d0>
2025-12-04 10:09:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:09:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72aa258f-b6f1-589c-bbc5-46b8611b81de/72aa258f-b6f1-589c-bbc5-46b8611b81de_image_10.jpg HTTP/1.1" 201 0
2025-12-04 10:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1cb85a0e-a40d-49eb-8e19-b5ce9aa98f86_ext_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1cb85a0e-a40d-49eb-8e19-b5ce9aa98f86_ext_5.jpg saved to cache
2025-12-04 10:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 72aa258f-b6f1-589c-bbc5-46b8611b81de
2025-12-04 10:09:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1cb85a0e-a40d-49eb-8e19-b5ce9aa98f86_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003612695-01974152-004.pdf)
2025-12-04 10:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3612695-3993592-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3612695-3993592-1002.jpg not downloaded yet
2025-12-04 10:09:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6999d0>
2025-12-04 10:09:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:09:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d428e59-cadd-5753-a5bf-34918c220e1e/8d428e59-cadd-5753-a5bf-34918c220e1e_expert_report_file_35ea3dd8-e82a-4ef3-9997-337672ff54e4.pdf HTTP/1.1" 201 0
2025-12-04 10:09:03 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 8d428e59-cadd-5753-a5bf-34918c220e1e
2025-12-04 10:09:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8d428e59-cadd-5753-a5bf-34918c220e1e, skipping ID generation
2025-12-04 10:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 8d428e59-cadd-5753-a5bf-34918c220e1e
2025-12-04 10:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F44dfdf9f-cdb5-4a4b-8530-eb77fd6d32c7_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/44dfdf9f-cdb5-4a4b-8530-eb77fd6d32c7_ext_7.jpg not downloaded yet
2025-12-04 10:09:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc69bd90>
2025-12-04 10:09:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:09:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72aa258f-b6f1-589c-bbc5-46b8611b81de/72aa258f-b6f1-589c-bbc5-46b8611b81de_image_11.jpg HTTP/1.1" 201 0
2025-12-04 10:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1cb85a0e-a40d-49eb-8e19-b5ce9aa98f86_ext_3.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1cb85a0e-a40d-49eb-8e19-b5ce9aa98f86_ext_3.jpg saved to cache
2025-12-04 10:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 72aa258f-b6f1-589c-bbc5-46b8611b81de
2025-12-04 10:09:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3612695-3993592-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003612695-01974152-004.pdf)
2025-12-04 10:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F44dfdf9f-cdb5-4a4b-8530-eb77fd6d32c7_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/44dfdf9f-cdb5-4a4b-8530-eb77fd6d32c7_ext_7.jpg not downloaded yet
2025-12-04 10:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F44dfdf9f-cdb5-4a4b-8530-eb77fd6d32c7_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/44dfdf9f-cdb5-4a4b-8530-eb77fd6d32c7_ext_6.jpg not downloaded yet
2025-12-04 10:09:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc7f5750>
2025-12-04 10:09:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 10:09:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72aa258f-b6f1-589c-bbc5-46b8611b81de/72aa258f-b6f1-589c-bbc5-46b8611b81de_image_12.jpg HTTP/1.1" 201 0
2025-12-04 10:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1cb85a0e-a40d-49eb-8e19-b5ce9aa98f86_ext_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1cb85a0e-a40d-49eb-8e19-b5ce9aa98f86_ext_4.jpg saved to cache
2025-12-04 10:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 72aa258f-b6f1-589c-bbc5-46b8611b81de
2025-12-04 10:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F44dfdf9f-cdb5-4a4b-8530-eb77fd6d32c7_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/44dfdf9f-cdb5-4a4b-8530-eb77fd6d32c7_ext_1.jpg not downloaded yet
2025-12-04 10:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F44dfdf9f-cdb5-4a4b-8530-eb77fd6d32c7_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/44dfdf9f-cdb5-4a4b-8530-eb77fd6d32c7_5.jpg not downloaded yet
2025-12-04 10:09:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3612695-3993592-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003612695-01974152-004.pdf)
2025-12-04 10:09:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3612695-3993592-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003612695-01974152-004.pdf)
2025-12-04 10:09:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/44dfdf9f-cdb5-4a4b-8530-eb77fd6d32c7_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000233754-01989638-001.pdf)
2025-12-04 10:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F44dfdf9f-cdb5-4a4b-8530-eb77fd6d32c7_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/44dfdf9f-cdb5-4a4b-8530-eb77fd6d32c7_4.jpg not downloaded yet
2025-12-04 10:09:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc651350>
2025-12-04 10:09:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:09:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72aa258f-b6f1-589c-bbc5-46b8611b81de/72aa258f-b6f1-589c-bbc5-46b8611b81de_image_13.jpg HTTP/1.1" 201 0
2025-12-04 10:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3612695-3993592-13.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3612695-3993592-13.jpg saved to cache
2025-12-04 10:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 72aa258f-b6f1-589c-bbc5-46b8611b81de
2025-12-04 10:09:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3612695-3993592-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003612695-01974152-004.pdf)
2025-12-04 10:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F44dfdf9f-cdb5-4a4b-8530-eb77fd6d32c7_11.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/44dfdf9f-cdb5-4a4b-8530-eb77fd6d32c7_11.jpg not downloaded yet
2025-12-04 10:09:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/44dfdf9f-cdb5-4a4b-8530-eb77fd6d32c7_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000233754-01989638-001.pdf)
2025-12-04 10:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F44dfdf9f-cdb5-4a4b-8530-eb77fd6d32c7_10.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/44dfdf9f-cdb5-4a4b-8530-eb77fd6d32c7_10.jpg not downloaded yet
2025-12-04 10:09:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/44dfdf9f-cdb5-4a4b-8530-eb77fd6d32c7_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000233754-01989638-001.pdf)
2025-12-04 10:09:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/44dfdf9f-cdb5-4a4b-8530-eb77fd6d32c7_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000233754-01989638-001.pdf)
2025-12-04 10:09:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc57b810>
2025-12-04 10:09:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:09:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72aa258f-b6f1-589c-bbc5-46b8611b81de/72aa258f-b6f1-589c-bbc5-46b8611b81de_image_15.jpg HTTP/1.1" 201 0
2025-12-04 10:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3612695-3993592-1001.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3612695-3993592-1001.jpg saved to cache
2025-12-04 10:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 72aa258f-b6f1-589c-bbc5-46b8611b81de
2025-12-04 10:09:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccefeb10>
2025-12-04 10:09:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:09:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72aa258f-b6f1-589c-bbc5-46b8611b81de/72aa258f-b6f1-589c-bbc5-46b8611b81de_image_16.jpg HTTP/1.1" 201 0
2025-12-04 10:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3612695-3993592-1002.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3612695-3993592-1002.jpg saved to cache
2025-12-04 10:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 72aa258f-b6f1-589c-bbc5-46b8611b81de
2025-12-04 10:09:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccefd890>
2025-12-04 10:09:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:09:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d428e59-cadd-5753-a5bf-34918c220e1e/8d428e59-cadd-5753-a5bf-34918c220e1e_image_0.jpg HTTP/1.1" 201 0
2025-12-04 10:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F44dfdf9f-cdb5-4a4b-8530-eb77fd6d32c7_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/44dfdf9f-cdb5-4a4b-8530-eb77fd6d32c7_ext_7.jpg saved to cache
2025-12-04 10:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8d428e59-cadd-5753-a5bf-34918c220e1e
2025-12-04 10:09:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003591726-01983844-002.pdf> (referer: None)
2025-12-04 10:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F44dfdf9f-cdb5-4a4b-8530-eb77fd6d32c7_9.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/44dfdf9f-cdb5-4a4b-8530-eb77fd6d32c7_9.jpg not downloaded yet
2025-12-04 10:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F44dfdf9f-cdb5-4a4b-8530-eb77fd6d32c7_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/44dfdf9f-cdb5-4a4b-8530-eb77fd6d32c7_ext_2.jpg not downloaded yet
2025-12-04 10:09:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/44dfdf9f-cdb5-4a4b-8530-eb77fd6d32c7_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000233754-01989638-001.pdf)
2025-12-04 10:09:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/44dfdf9f-cdb5-4a4b-8530-eb77fd6d32c7_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000233754-01989638-001.pdf)
2025-12-04 10:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F44dfdf9f-cdb5-4a4b-8530-eb77fd6d32c7_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/44dfdf9f-cdb5-4a4b-8530-eb77fd6d32c7_ext_5.jpg not downloaded yet
2025-12-04 10:09:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6a6d90>
2025-12-04 10:09:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:09:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72aa258f-b6f1-589c-bbc5-46b8611b81de/72aa258f-b6f1-589c-bbc5-46b8611b81de_image_14.jpg HTTP/1.1" 201 0
2025-12-04 10:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3612695-3993592-1000.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3612695-3993592-1000.jpg saved to cache
2025-12-04 10:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 72aa258f-b6f1-589c-bbc5-46b8611b81de
2025-12-04 10:09:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 72aa258f-b6f1-589c-bbc5-46b8611b81de, skipping ID generation
2025-12-04 10:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 72aa258f-b6f1-589c-bbc5-46b8611b81de from tracking dictionaries
2025-12-04 10:09:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 72aa258f-b6f1-589c-bbc5-46b8611b81de sending to next pipeline
2025-12-04 10:09:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 72aa258f-b6f1-589c-bbc5-46b8611b81de, identifier: 3612695
2025-12-04 10:09:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc68cc90>
2025-12-04 10:09:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:09:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d428e59-cadd-5753-a5bf-34918c220e1e/8d428e59-cadd-5753-a5bf-34918c220e1e_image_3.jpg HTTP/1.1" 201 0
2025-12-04 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F44dfdf9f-cdb5-4a4b-8530-eb77fd6d32c7_ext_1.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/44dfdf9f-cdb5-4a4b-8530-eb77fd6d32c7_ext_1.jpg saved to cache
2025-12-04 10:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8d428e59-cadd-5753-a5bf-34918c220e1e
2025-12-04 10:09:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd0c2c10>
2025-12-04 10:09:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:09:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d428e59-cadd-5753-a5bf-34918c220e1e/8d428e59-cadd-5753-a5bf-34918c220e1e_image_1.jpg HTTP/1.1" 201 0
2025-12-04 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F44dfdf9f-cdb5-4a4b-8530-eb77fd6d32c7_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/44dfdf9f-cdb5-4a4b-8530-eb77fd6d32c7_ext_7.jpg saved to cache
2025-12-04 10:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8d428e59-cadd-5753-a5bf-34918c220e1e
2025-12-04 10:09:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc71bbd0>
2025-12-04 10:09:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:09:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d428e59-cadd-5753-a5bf-34918c220e1e/8d428e59-cadd-5753-a5bf-34918c220e1e_image_2.jpg HTTP/1.1" 201 0
2025-12-04 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F44dfdf9f-cdb5-4a4b-8530-eb77fd6d32c7_ext_6.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/44dfdf9f-cdb5-4a4b-8530-eb77fd6d32c7_ext_6.jpg saved to cache
2025-12-04 10:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8d428e59-cadd-5753-a5bf-34918c220e1e
2025-12-04 10:09:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003603120-01980610-002.pdf> (referer: None)
2025-12-04 10:09:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 72aa258f-b6f1-589c-bbc5-46b8611b81de with identifier: 3612695
2025-12-04 10:09:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 72aa258f-b6f1-589c-bbc5-46b8611b81de with identifier: 3612695
2025-12-04 10:09:06 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 72aa258f-b6f1-589c-bbc5-46b8611b81de with identifier: 3612695 to the API
2025-12-04 10:09:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 10:09:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 10:09:07 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/insp-0001-3612695-3993592-1000.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 32,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72aa258f-b6f1-589c-bbc5-46b8611b81de/72aa258f-b6f1-589c-bbc5-46b8611b81de_expert_report_file_abfcacb0-39c1-4966-89a3-e8710277b4c6.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003612695-01974152-004.pdf',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '2.5L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Petrol PHEV',
 'id': '72aa258f-b6f1-589c-bbc5-46b8611b81de',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'DV71BRX',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FORD/KUGA?id=3612695',
 'listing': 'auction',
 'location': 'Bristol',
 'make': 'FORD',
 'model': 'KUGA',
 'odometer': 33311,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72aa258f-b6f1-589c-bbc5-46b8611b81de/72aa258f-b6f1-589c-bbc5-46b8611b81de_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 221377,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1cb85a0e-a40d-49eb-8e19-b5ce9aa98f86_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72aa258f-b6f1-589c-bbc5-46b8611b81de/72aa258f-b6f1-589c-bbc5-46b8611b81de_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 221377,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1cb85a0e-a40d-49eb-8e19-b5ce9aa98f86_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72aa258f-b6f1-589c-bbc5-46b8611b81de/72aa258f-b6f1-589c-bbc5-46b8611b81de_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 209892,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1cb85a0e-a40d-49eb-8e19-b5ce9aa98f86_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72aa258f-b6f1-589c-bbc5-46b8611b81de/72aa258f-b6f1-589c-bbc5-46b8611b81de_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 156619,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1cb85a0e-a40d-49eb-8e19-b5ce9aa98f86_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72aa258f-b6f1-589c-bbc5-46b8611b81de/72aa258f-b6f1-589c-bbc5-46b8611b81de_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 231604,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1cb85a0e-a40d-49eb-8e19-b5ce9aa98f86_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72aa258f-b6f1-589c-bbc5-46b8611b81de/72aa258f-b6f1-589c-bbc5-46b8611b81de_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 211578,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1cb85a0e-a40d-49eb-8e19-b5ce9aa98f86_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72aa258f-b6f1-589c-bbc5-46b8611b81de/72aa258f-b6f1-589c-bbc5-46b8611b81de_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 187230,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1cb85a0e-a40d-49eb-8e19-b5ce9aa98f86_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72aa258f-b6f1-589c-bbc5-46b8611b81de/72aa258f-b6f1-589c-bbc5-46b8611b81de_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 191109,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1cb85a0e-a40d-49eb-8e19-b5ce9aa98f86_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72aa258f-b6f1-589c-bbc5-46b8611b81de/72aa258f-b6f1-589c-bbc5-46b8611b81de_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 207018,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1cb85a0e-a40d-49eb-8e19-b5ce9aa98f86_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72aa258f-b6f1-589c-bbc5-46b8611b81de/72aa258f-b6f1-589c-bbc5-46b8611b81de_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 192406,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1cb85a0e-a40d-49eb-8e19-b5ce9aa98f86_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72aa258f-b6f1-589c-bbc5-46b8611b81de/72aa258f-b6f1-589c-bbc5-46b8611b81de_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 185853,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1cb85a0e-a40d-49eb-8e19-b5ce9aa98f86_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72aa258f-b6f1-589c-bbc5-46b8611b81de/72aa258f-b6f1-589c-bbc5-46b8611b81de_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 189955,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1cb85a0e-a40d-49eb-8e19-b5ce9aa98f86_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72aa258f-b6f1-589c-bbc5-46b8611b81de/72aa258f-b6f1-589c-bbc5-46b8611b81de_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 145992,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1cb85a0e-a40d-49eb-8e19-b5ce9aa98f86_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72aa258f-b6f1-589c-bbc5-46b8611b81de/72aa258f-b6f1-589c-bbc5-46b8611b81de_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 275890,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3612695-3993592-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72aa258f-b6f1-589c-bbc5-46b8611b81de/72aa258f-b6f1-589c-bbc5-46b8611b81de_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 293096,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3612695-3993592-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72aa258f-b6f1-589c-bbc5-46b8611b81de/72aa258f-b6f1-589c-bbc5-46b8611b81de_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 172992,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3612695-3993592-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72aa258f-b6f1-589c-bbc5-46b8611b81de/72aa258f-b6f1-589c-bbc5-46b8611b81de_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 144464,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3612695-3993592-1002.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-30',
 'seller_name': 'Novuna Vehicle Solutions',
 'title': 'FORD KUGA 2.5 PHEV ST-Line 5dr CVT',
 'transmission': 'automatic',
 'trim': '2.5 PHEV ST-Line 5dr CVT',
 'year': 2021}
2025-12-04 10:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273612695%27 HTTP/1.1" 200 None
2025-12-04 10:09:07 [manheim.gb] INFO: Saving data for 3612695: {'created_time': 1764842947.128035, 'last_price_update_time': 1764842947.128046, 'auction_closing_time': 1765270800.0}
2025-12-04 10:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3612695') HTTP/1.1" 204 0
2025-12-04 10:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F44dfdf9f-cdb5-4a4b-8530-eb77fd6d32c7_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/44dfdf9f-cdb5-4a4b-8530-eb77fd6d32c7_ext_3.jpg not downloaded yet
2025-12-04 10:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F44dfdf9f-cdb5-4a4b-8530-eb77fd6d32c7_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/44dfdf9f-cdb5-4a4b-8530-eb77fd6d32c7_ext_4.jpg not downloaded yet
2025-12-04 10:09:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc67d110>
2025-12-04 10:09:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:09:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_expert_report_file_62075d27-45d1-457d-b8b5-f904d6cfe288.pdf HTTP/1.1" 201 0
2025-12-04 10:09:07 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 9152002f-8509-5dfc-8979-17e1975e2490
2025-12-04 10:09:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9152002f-8509-5dfc-8979-17e1975e2490, skipping ID generation
2025-12-04 10:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 9152002f-8509-5dfc-8979-17e1975e2490
2025-12-04 10:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F69318400-e473-4540-89a8-86cb0408a9cf_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_ext_7.jpg not downloaded yet
2025-12-04 10:09:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ce39bed0>
2025-12-04 10:09:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:09:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d428e59-cadd-5753-a5bf-34918c220e1e/8d428e59-cadd-5753-a5bf-34918c220e1e_image_4.jpg HTTP/1.1" 201 0
2025-12-04 10:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F44dfdf9f-cdb5-4a4b-8530-eb77fd6d32c7_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/44dfdf9f-cdb5-4a4b-8530-eb77fd6d32c7_5.jpg saved to cache
2025-12-04 10:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8d428e59-cadd-5753-a5bf-34918c220e1e
2025-12-04 10:09:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd0075d0>
2025-12-04 10:09:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:09:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d428e59-cadd-5753-a5bf-34918c220e1e/8d428e59-cadd-5753-a5bf-34918c220e1e_image_5.jpg HTTP/1.1" 201 0
2025-12-04 10:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F44dfdf9f-cdb5-4a4b-8530-eb77fd6d32c7_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/44dfdf9f-cdb5-4a4b-8530-eb77fd6d32c7_4.jpg saved to cache
2025-12-04 10:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8d428e59-cadd-5753-a5bf-34918c220e1e
2025-12-04 10:09:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd0c3a90>
2025-12-04 10:09:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:09:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03/e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03_expert_report_file_ed362e2e-f8c3-4f19-be89-c8734a5e4076.pdf HTTP/1.1" 201 0
2025-12-04 10:09:08 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03
2025-12-04 10:09:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03, skipping ID generation
2025-12-04 10:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03
2025-12-04 10:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3eab9e01-1605-468d-b573-23f340fb09cb_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3eab9e01-1605-468d-b573-23f340fb09cb_ext_7.jpg not downloaded yet
2025-12-04 10:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-233754-4007445-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-233754-4007445-13.jpg not downloaded yet
2025-12-04 10:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F69318400-e473-4540-89a8-86cb0408a9cf_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_ext_7.jpg not downloaded yet
2025-12-04 10:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3eab9e01-1605-468d-b573-23f340fb09cb_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3eab9e01-1605-468d-b573-23f340fb09cb_ext_7.jpg not downloaded yet
2025-12-04 10:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-233754-4007445-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-233754-4007445-1000.jpg not downloaded yet
2025-12-04 10:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F69318400-e473-4540-89a8-86cb0408a9cf_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_ext_6.jpg not downloaded yet
2025-12-04 10:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3eab9e01-1605-468d-b573-23f340fb09cb_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3eab9e01-1605-468d-b573-23f340fb09cb_ext_6.jpg not downloaded yet
2025-12-04 10:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-233754-4007445-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-233754-4007445-1001.jpg not downloaded yet
2025-12-04 10:09:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003595741-01892146-002.pdf> (referer: None)
2025-12-04 10:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F69318400-e473-4540-89a8-86cb0408a9cf_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_ext_1.jpg not downloaded yet
2025-12-04 10:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3eab9e01-1605-468d-b573-23f340fb09cb_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3eab9e01-1605-468d-b573-23f340fb09cb_ext_1.jpg not downloaded yet
2025-12-04 10:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-233754-4007445-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-233754-4007445-1002.jpg not downloaded yet
2025-12-04 10:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F69318400-e473-4540-89a8-86cb0408a9cf_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_5.jpg not downloaded yet
2025-12-04 10:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3eab9e01-1605-468d-b573-23f340fb09cb_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3eab9e01-1605-468d-b573-23f340fb09cb_5.jpg not downloaded yet
2025-12-04 10:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-233754-4007445-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-233754-4007445-1003.jpg not downloaded yet
2025-12-04 10:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F69318400-e473-4540-89a8-86cb0408a9cf_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_4.jpg not downloaded yet
2025-12-04 10:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3eab9e01-1605-468d-b573-23f340fb09cb_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3eab9e01-1605-468d-b573-23f340fb09cb_4.jpg not downloaded yet
2025-12-04 10:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-233754-4007445-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-233754-4007445-1004.jpg not downloaded yet
2025-12-04 10:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F69318400-e473-4540-89a8-86cb0408a9cf_11.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_11.jpg not downloaded yet
2025-12-04 10:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3eab9e01-1605-468d-b573-23f340fb09cb_11.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3eab9e01-1605-468d-b573-23f340fb09cb_11.jpg not downloaded yet
2025-12-04 10:09:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccfae350>
2025-12-04 10:09:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:09:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd0352b1-6dcd-5f8c-abf1-303ebe222f63/bd0352b1-6dcd-5f8c-abf1-303ebe222f63_expert_report_file_cc3b74f1-9dc0-4ddb-8acf-f92cbeb931af.pdf HTTP/1.1" 201 0
2025-12-04 10:09:09 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item bd0352b1-6dcd-5f8c-abf1-303ebe222f63
2025-12-04 10:09:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bd0352b1-6dcd-5f8c-abf1-303ebe222f63, skipping ID generation
2025-12-04 10:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item bd0352b1-6dcd-5f8c-abf1-303ebe222f63
2025-12-04 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F99011fda-34e0-4410-a910-2cd7a894cd3d_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/99011fda-34e0-4410-a910-2cd7a894cd3d_ext_7.jpg already downloaded
2025-12-04 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F99011fda-34e0-4410-a910-2cd7a894cd3d_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/99011fda-34e0-4410-a910-2cd7a894cd3d_ext_7.jpg already downloaded
2025-12-04 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F99011fda-34e0-4410-a910-2cd7a894cd3d_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/99011fda-34e0-4410-a910-2cd7a894cd3d_ext_6.jpg already downloaded
2025-12-04 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F99011fda-34e0-4410-a910-2cd7a894cd3d_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/99011fda-34e0-4410-a910-2cd7a894cd3d_ext_1.jpg already downloaded
2025-12-04 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F99011fda-34e0-4410-a910-2cd7a894cd3d_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/99011fda-34e0-4410-a910-2cd7a894cd3d_5.jpg already downloaded
2025-12-04 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F99011fda-34e0-4410-a910-2cd7a894cd3d_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/99011fda-34e0-4410-a910-2cd7a894cd3d_4.jpg already downloaded
2025-12-04 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F99011fda-34e0-4410-a910-2cd7a894cd3d_11.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/99011fda-34e0-4410-a910-2cd7a894cd3d_11.jpg already downloaded
2025-12-04 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F99011fda-34e0-4410-a910-2cd7a894cd3d_10.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/99011fda-34e0-4410-a910-2cd7a894cd3d_10.jpg already downloaded
2025-12-04 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F99011fda-34e0-4410-a910-2cd7a894cd3d_9.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/99011fda-34e0-4410-a910-2cd7a894cd3d_9.jpg already downloaded
2025-12-04 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F99011fda-34e0-4410-a910-2cd7a894cd3d_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/99011fda-34e0-4410-a910-2cd7a894cd3d_ext_2.jpg already downloaded
2025-12-04 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F99011fda-34e0-4410-a910-2cd7a894cd3d_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/99011fda-34e0-4410-a910-2cd7a894cd3d_ext_5.jpg already downloaded
2025-12-04 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F99011fda-34e0-4410-a910-2cd7a894cd3d_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/99011fda-34e0-4410-a910-2cd7a894cd3d_ext_3.jpg already downloaded
2025-12-04 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F99011fda-34e0-4410-a910-2cd7a894cd3d_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/99011fda-34e0-4410-a910-2cd7a894cd3d_ext_4.jpg already downloaded
2025-12-04 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3595741-3885069-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3595741-3885069-13.jpg already downloaded
2025-12-04 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3595741-3885069-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3595741-3885069-1000.jpg already downloaded
2025-12-04 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3595741-3885069-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3595741-3885069-1001.jpg already downloaded
2025-12-04 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3595741-3885069-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3595741-3885069-1002.jpg already downloaded
2025-12-04 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3595741-3885069-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3595741-3885069-1003.jpg already downloaded
2025-12-04 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3595741-3885069-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3595741-3885069-1004.jpg already downloaded
2025-12-04 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3595741-3885069-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3595741-3885069-1005.jpg already downloaded
2025-12-04 10:09:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: bd0352b1-6dcd-5f8c-abf1-303ebe222f63, identifier: 3595741
2025-12-04 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-233754-4007445-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-233754-4007445-1005.jpg not downloaded yet
2025-12-04 10:09:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: bd0352b1-6dcd-5f8c-abf1-303ebe222f63 with identifier: 3595741
2025-12-04 10:09:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: bd0352b1-6dcd-5f8c-abf1-303ebe222f63 with identifier: 3595741
2025-12-04 10:09:09 [scrapy.core.scraper] INFO: Dropped: Dropping expired listing: bd0352b1-6dcd-5f8c-abf1-303ebe222f63 with expiration date: 2025-12-04T09:00:00Z
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd0352b1-6dcd-5f8c-abf1-303ebe222f63/bd0352b1-6dcd-5f8c-abf1-303ebe222f63_expert_report_file_cc3b74f1-9dc0-4ddb-8acf-f92cbeb931af.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003595741-01892146-002.pdf',
 'color': 'RED',
 'currency': 'GBP',
 'engine': '1.4L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'bd0352b1-6dcd-5f8c-abf1-303ebe222f63',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'PJ65SCX',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/ABARTH/595?id=3595741',
 'listing': 'auction',
 'location': 'Manchester',
 'make': 'ABARTH',
 'model': '595',
 'odometer': 63734,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 36,
 'photo_urls': ['http://images.manheim.co.uk/images/units/zoom/99011fda-34e0-4410-a910-2cd7a894cd3d_ext_7.jpg',
                'http://images.manheim.co.uk/images/units/zoom/99011fda-34e0-4410-a910-2cd7a894cd3d_ext_7.jpg',
                'http://images.manheim.co.uk/images/units/zoom/99011fda-34e0-4410-a910-2cd7a894cd3d_ext_6.jpg',
                'http://images.manheim.co.uk/images/units/zoom/99011fda-34e0-4410-a910-2cd7a894cd3d_ext_1.jpg',
                'http://images.manheim.co.uk/images/units/zoom/99011fda-34e0-4410-a910-2cd7a894cd3d_5.jpg',
                'http://images.manheim.co.uk/images/units/zoom/99011fda-34e0-4410-a910-2cd7a894cd3d_4.jpg',
                'http://images.manheim.co.uk/images/units/zoom/99011fda-34e0-4410-a910-2cd7a894cd3d_11.jpg',
                'http://images.manheim.co.uk/images/units/zoom/99011fda-34e0-4410-a910-2cd7a894cd3d_10.jpg',
                'http://images.manheim.co.uk/images/units/zoom/99011fda-34e0-4410-a910-2cd7a894cd3d_9.jpg',
                'http://images.manheim.co.uk/images/units/zoom/99011fda-34e0-4410-a910-2cd7a894cd3d_ext_2.jpg',
                'http://images.manheim.co.uk/images/units/zoom/99011fda-34e0-4410-a910-2cd7a894cd3d_ext_5.jpg',
                'http://images.manheim.co.uk/images/units/zoom/99011fda-34e0-4410-a910-2cd7a894cd3d_ext_3.jpg',
                'http://images.manheim.co.uk/images/units/zoom/99011fda-34e0-4410-a910-2cd7a894cd3d_ext_4.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3595741-3885069-13.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3595741-3885069-1000.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3595741-3885069-1001.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3595741-3885069-1002.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3595741-3885069-1003.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3595741-3885069-1004.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3595741-3885069-1005.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd0352b1-6dcd-5f8c-abf1-303ebe222f63/bd0352b1-6dcd-5f8c-abf1-303ebe222f63_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 143107,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/99011fda-34e0-4410-a910-2cd7a894cd3d_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd0352b1-6dcd-5f8c-abf1-303ebe222f63/bd0352b1-6dcd-5f8c-abf1-303ebe222f63_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 143107,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/99011fda-34e0-4410-a910-2cd7a894cd3d_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd0352b1-6dcd-5f8c-abf1-303ebe222f63/bd0352b1-6dcd-5f8c-abf1-303ebe222f63_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 256200,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/99011fda-34e0-4410-a910-2cd7a894cd3d_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd0352b1-6dcd-5f8c-abf1-303ebe222f63/bd0352b1-6dcd-5f8c-abf1-303ebe222f63_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 187985,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/99011fda-34e0-4410-a910-2cd7a894cd3d_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd0352b1-6dcd-5f8c-abf1-303ebe222f63/bd0352b1-6dcd-5f8c-abf1-303ebe222f63_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 168871,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/99011fda-34e0-4410-a910-2cd7a894cd3d_5.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd0352b1-6dcd-5f8c-abf1-303ebe222f63/bd0352b1-6dcd-5f8c-abf1-303ebe222f63_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 144473,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/99011fda-34e0-4410-a910-2cd7a894cd3d_4.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd0352b1-6dcd-5f8c-abf1-303ebe222f63/bd0352b1-6dcd-5f8c-abf1-303ebe222f63_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 162377,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/99011fda-34e0-4410-a910-2cd7a894cd3d_11.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd0352b1-6dcd-5f8c-abf1-303ebe222f63/bd0352b1-6dcd-5f8c-abf1-303ebe222f63_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 161567,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/99011fda-34e0-4410-a910-2cd7a894cd3d_10.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd0352b1-6dcd-5f8c-abf1-303ebe222f63/bd0352b1-6dcd-5f8c-abf1-303ebe222f63_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 157621,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/99011fda-34e0-4410-a910-2cd7a894cd3d_9.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd0352b1-6dcd-5f8c-abf1-303ebe222f63/bd0352b1-6dcd-5f8c-abf1-303ebe222f63_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 262552,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/99011fda-34e0-4410-a910-2cd7a894cd3d_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd0352b1-6dcd-5f8c-abf1-303ebe222f63/bd0352b1-6dcd-5f8c-abf1-303ebe222f63_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 188050,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/99011fda-34e0-4410-a910-2cd7a894cd3d_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd0352b1-6dcd-5f8c-abf1-303ebe222f63/bd0352b1-6dcd-5f8c-abf1-303ebe222f63_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 204665,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/99011fda-34e0-4410-a910-2cd7a894cd3d_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd0352b1-6dcd-5f8c-abf1-303ebe222f63/bd0352b1-6dcd-5f8c-abf1-303ebe222f63_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 239945,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/99011fda-34e0-4410-a910-2cd7a894cd3d_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd0352b1-6dcd-5f8c-abf1-303ebe222f63/bd0352b1-6dcd-5f8c-abf1-303ebe222f63_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 326212,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3595741-3885069-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd0352b1-6dcd-5f8c-abf1-303ebe222f63/bd0352b1-6dcd-5f8c-abf1-303ebe222f63_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 360648,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3595741-3885069-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd0352b1-6dcd-5f8c-abf1-303ebe222f63/bd0352b1-6dcd-5f8c-abf1-303ebe222f63_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 251730,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3595741-3885069-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd0352b1-6dcd-5f8c-abf1-303ebe222f63/bd0352b1-6dcd-5f8c-abf1-303ebe222f63_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 282233,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3595741-3885069-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd0352b1-6dcd-5f8c-abf1-303ebe222f63/bd0352b1-6dcd-5f8c-abf1-303ebe222f63_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 251238,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3595741-3885069-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd0352b1-6dcd-5f8c-abf1-303ebe222f63/bd0352b1-6dcd-5f8c-abf1-303ebe222f63_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 367617,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3595741-3885069-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd0352b1-6dcd-5f8c-abf1-303ebe222f63/bd0352b1-6dcd-5f8c-abf1-303ebe222f63_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 327539,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3595741-3885069-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-29',
 'seller_name': 'FCA Group',
 'title': 'ABARTH 595 1.4 T-Jet 140 2dr',
 'transmission': 'manual',
 'trim': '1.4 T-Jet 140 2dr',
 'year': 2016}
2025-12-04 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273595741%27 HTTP/1.1" 200 None
2025-12-04 10:09:09 [manheim.gb] INFO: Saving data for 3595741: {'created_time': 1764842949.829223, 'last_price_update_time': 1764842949.829232, 'auction_closing_time': 1764838800.0}
2025-12-04 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3595741') HTTP/1.1" 204 0
2025-12-04 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F69318400-e473-4540-89a8-86cb0408a9cf_10.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_10.jpg not downloaded yet
2025-12-04 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3eab9e01-1605-468d-b573-23f340fb09cb_10.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3eab9e01-1605-468d-b573-23f340fb09cb_10.jpg not downloaded yet
2025-12-04 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F69318400-e473-4540-89a8-86cb0408a9cf_9.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_9.jpg not downloaded yet
2025-12-04 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3eab9e01-1605-468d-b573-23f340fb09cb_9.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3eab9e01-1605-468d-b573-23f340fb09cb_9.jpg not downloaded yet
2025-12-04 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F69318400-e473-4540-89a8-86cb0408a9cf_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_ext_2.jpg not downloaded yet
2025-12-04 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3eab9e01-1605-468d-b573-23f340fb09cb_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3eab9e01-1605-468d-b573-23f340fb09cb_ext_2.jpg not downloaded yet
2025-12-04 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F69318400-e473-4540-89a8-86cb0408a9cf_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_ext_5.jpg not downloaded yet
2025-12-04 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3eab9e01-1605-468d-b573-23f340fb09cb_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3eab9e01-1605-468d-b573-23f340fb09cb_ext_5.jpg not downloaded yet
2025-12-04 10:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F69318400-e473-4540-89a8-86cb0408a9cf_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_ext_3.jpg not downloaded yet
2025-12-04 10:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3eab9e01-1605-468d-b573-23f340fb09cb_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3eab9e01-1605-468d-b573-23f340fb09cb_ext_3.jpg not downloaded yet
2025-12-04 10:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F69318400-e473-4540-89a8-86cb0408a9cf_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_ext_4.jpg not downloaded yet
2025-12-04 10:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3eab9e01-1605-468d-b573-23f340fb09cb_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3eab9e01-1605-468d-b573-23f340fb09cb_ext_4.jpg not downloaded yet
2025-12-04 10:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3591726-4003111-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3591726-4003111-13.jpg not downloaded yet
2025-12-04 10:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3603120-3999879-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3603120-3999879-13.jpg not downloaded yet
2025-12-04 10:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3591726-4003111-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3591726-4003111-1000.jpg not downloaded yet
2025-12-04 10:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3603120-3999879-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3603120-3999879-1000.jpg not downloaded yet
2025-12-04 10:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3591726-4003111-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3591726-4003111-1001.jpg not downloaded yet
2025-12-04 10:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3603120-3999879-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3603120-3999879-1001.jpg not downloaded yet
2025-12-04 10:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3591726-4003111-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3591726-4003111-1002.jpg not downloaded yet
2025-12-04 10:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3603120-3999879-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3603120-3999879-1002.jpg not downloaded yet
2025-12-04 10:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3591726-4003111-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3591726-4003111-1003.jpg not downloaded yet
2025-12-04 10:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3603120-3999879-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3603120-3999879-1003.jpg not downloaded yet
2025-12-04 10:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3591726-4003111-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3591726-4003111-1004.jpg not downloaded yet
2025-12-04 10:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3603120-3999879-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3603120-3999879-1004.jpg not downloaded yet
2025-12-04 10:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3591726-4003111-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3591726-4003111-1005.jpg not downloaded yet
2025-12-04 10:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3603120-3999879-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3603120-3999879-1005.jpg not downloaded yet
2025-12-04 10:09:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3591726-4003111-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003591726-01983844-002.pdf)
2025-12-04 10:09:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3603120-3999879-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003603120-01980610-002.pdf)
2025-12-04 10:09:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3591726-4003111-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003591726-01983844-002.pdf)
2025-12-04 10:09:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc53ed90>
2025-12-04 10:09:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:09:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_18.jpg HTTP/1.1" 201 0
2025-12-04 10:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3591726-4003111-1004.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3591726-4003111-1004.jpg saved to cache
2025-12-04 10:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 9152002f-8509-5dfc-8979-17e1975e2490
2025-12-04 10:09:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3603120-3999879-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003603120-01980610-002.pdf)
2025-12-04 10:09:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3603120-3999879-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003603120-01980610-002.pdf)
2025-12-04 10:09:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3603120-3999879-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003603120-01980610-002.pdf)
2025-12-04 10:09:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf61990>
2025-12-04 10:09:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:09:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03/e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03_image_17.jpg HTTP/1.1" 201 0
2025-12-04 10:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3603120-3999879-1003.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3603120-3999879-1003.jpg saved to cache
2025-12-04 10:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03
2025-12-04 10:09:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6c4bd0>
2025-12-04 10:09:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:09:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_17.jpg HTTP/1.1" 201 0
2025-12-04 10:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3591726-4003111-1003.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3591726-4003111-1003.jpg saved to cache
2025-12-04 10:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 9152002f-8509-5dfc-8979-17e1975e2490
2025-12-04 10:09:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3603120-3999879-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003603120-01980610-002.pdf)
2025-12-04 10:09:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3603120-3999879-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003603120-01980610-002.pdf)
2025-12-04 10:09:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3591726-4003111-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003591726-01983844-002.pdf)
2025-12-04 10:09:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3591726-4003111-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003591726-01983844-002.pdf)
2025-12-04 10:09:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3591726-4003111-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003591726-01983844-002.pdf)
2025-12-04 10:09:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce27c10>
2025-12-04 10:09:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:09:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03/e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03_image_18.jpg HTTP/1.1" 201 0
2025-12-04 10:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3603120-3999879-1004.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3603120-3999879-1004.jpg saved to cache
2025-12-04 10:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03
2025-12-04 10:09:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd54d10>
2025-12-04 10:09:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:09:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03/e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03_image_19.jpg HTTP/1.1" 201 0
2025-12-04 10:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3603120-3999879-1005.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3603120-3999879-1005.jpg saved to cache
2025-12-04 10:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03
2025-12-04 10:09:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce769d0>
2025-12-04 10:09:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:09:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03/e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03_image_16.jpg HTTP/1.1" 201 0
2025-12-04 10:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3603120-3999879-1002.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3603120-3999879-1002.jpg saved to cache
2025-12-04 10:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03
2025-12-04 10:09:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3591726-4003111-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003591726-01983844-002.pdf)
2025-12-04 10:09:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003591726-01983844-002.pdf)
2025-12-04 10:09:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3603120-3999879-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003603120-01980610-002.pdf)
2025-12-04 10:09:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3eab9e01-1605-468d-b573-23f340fb09cb_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003603120-01980610-002.pdf)
2025-12-04 10:09:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003591726-01983844-002.pdf)
2025-12-04 10:09:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3eab9e01-1605-468d-b573-23f340fb09cb_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003603120-01980610-002.pdf)
2025-12-04 10:09:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3eab9e01-1605-468d-b573-23f340fb09cb_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003603120-01980610-002.pdf)
2025-12-04 10:09:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccc80110>
2025-12-04 10:09:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:09:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03/e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03_image_15.jpg HTTP/1.1" 201 0
2025-12-04 10:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3603120-3999879-1001.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3603120-3999879-1001.jpg saved to cache
2025-12-04 10:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03
2025-12-04 10:09:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd89ad0>
2025-12-04 10:09:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:09:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03/e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03_image_14.jpg HTTP/1.1" 201 0
2025-12-04 10:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3603120-3999879-1000.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3603120-3999879-1000.jpg saved to cache
2025-12-04 10:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03
2025-12-04 10:09:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccfd1d10>
2025-12-04 10:09:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:09:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_16.jpg HTTP/1.1" 201 0
2025-12-04 10:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3591726-4003111-1002.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3591726-4003111-1002.jpg saved to cache
2025-12-04 10:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 9152002f-8509-5dfc-8979-17e1975e2490
2025-12-04 10:09:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd8b850>
2025-12-04 10:09:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:09:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_19.jpg HTTP/1.1" 201 0
2025-12-04 10:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3591726-4003111-1005.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3591726-4003111-1005.jpg saved to cache
2025-12-04 10:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 9152002f-8509-5dfc-8979-17e1975e2490
2025-12-04 10:09:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccfd0090>
2025-12-04 10:09:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:09:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_15.jpg HTTP/1.1" 201 0
2025-12-04 10:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3591726-4003111-1001.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3591726-4003111-1001.jpg saved to cache
2025-12-04 10:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 9152002f-8509-5dfc-8979-17e1975e2490
2025-12-04 10:09:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VOLVO/XC90?id=3586152&returnUrl=%2Fsearch%3FPage%3D4%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233586152&indx=305> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 10:09:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3591726-4003111-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003591726-01983844-002.pdf)
2025-12-04 10:09:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003591726-01983844-002.pdf)
2025-12-04 10:09:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf0ad50>
2025-12-04 10:09:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:09:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_14.jpg HTTP/1.1" 201 0
2025-12-04 10:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3591726-4003111-1000.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3591726-4003111-1000.jpg saved to cache
2025-12-04 10:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 9152002f-8509-5dfc-8979-17e1975e2490
2025-12-04 10:09:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5964d0>
2025-12-04 10:09:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:09:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_12.jpg HTTP/1.1" 201 0
2025-12-04 10:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F69318400-e473-4540-89a8-86cb0408a9cf_ext_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_ext_4.jpg saved to cache
2025-12-04 10:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 9152002f-8509-5dfc-8979-17e1975e2490
2025-12-04 10:09:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf09310>
2025-12-04 10:09:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:09:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03/e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03_image_13.jpg HTTP/1.1" 201 0
2025-12-04 10:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3603120-3999879-13.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3603120-3999879-13.jpg saved to cache
2025-12-04 10:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03
2025-12-04 10:09:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc601710>
2025-12-04 10:09:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:09:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03/e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03_image_12.jpg HTTP/1.1" 201 0
2025-12-04 10:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3eab9e01-1605-468d-b573-23f340fb09cb_ext_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3eab9e01-1605-468d-b573-23f340fb09cb_ext_4.jpg saved to cache
2025-12-04 10:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03
2025-12-04 10:09:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc603110>
2025-12-04 10:09:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:09:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_11.jpg HTTP/1.1" 201 0
2025-12-04 10:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F69318400-e473-4540-89a8-86cb0408a9cf_ext_3.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_ext_3.jpg saved to cache
2025-12-04 10:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 9152002f-8509-5dfc-8979-17e1975e2490
2025-12-04 10:09:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccdb4990>
2025-12-04 10:09:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:09:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03/e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03_image_10.jpg HTTP/1.1" 201 0
2025-12-04 10:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3eab9e01-1605-468d-b573-23f340fb09cb_ext_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3eab9e01-1605-468d-b573-23f340fb09cb_ext_5.jpg saved to cache
2025-12-04 10:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03
2025-12-04 10:09:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc7ecd90>
2025-12-04 10:09:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:09:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03/e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03_image_11.jpg HTTP/1.1" 201 0
2025-12-04 10:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3eab9e01-1605-468d-b573-23f340fb09cb_ext_3.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3eab9e01-1605-468d-b573-23f340fb09cb_ext_3.jpg saved to cache
2025-12-04 10:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03
2025-12-04 10:09:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/PEUGEOT/108?id=358707&returnUrl=%2Fsearch%3FPage%3D4%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%23358707&indx=306> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 10:09:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-233754-4007445-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000233754-01989638-001.pdf)
2025-12-04 10:09:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003591726-01983844-002.pdf)
2025-12-04 10:09:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3eab9e01-1605-468d-b573-23f340fb09cb_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003603120-01980610-002.pdf)
2025-12-04 10:09:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3eab9e01-1605-468d-b573-23f340fb09cb_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003603120-01980610-002.pdf)
2025-12-04 10:09:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3eab9e01-1605-468d-b573-23f340fb09cb_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003603120-01980610-002.pdf)
2025-12-04 10:09:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003591726-01983844-002.pdf)
2025-12-04 10:09:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 962271fe-0bbf-54ca-9150-79ce7988e6d2 with identifier: 3586152
2025-12-04 10:09:15 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 962271fe-0bbf-54ca-9150-79ce7988e6d2
2025-12-04 10:09:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc69c7d0>
2025-12-04 10:09:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:09:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_13.jpg HTTP/1.1" 201 0
2025-12-04 10:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3591726-4003111-13.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3591726-4003111-13.jpg saved to cache
2025-12-04 10:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 9152002f-8509-5dfc-8979-17e1975e2490
2025-12-04 10:09:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc7f6990>
2025-12-04 10:09:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:09:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_10.jpg HTTP/1.1" 201 0
2025-12-04 10:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F69318400-e473-4540-89a8-86cb0408a9cf_ext_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_ext_5.jpg saved to cache
2025-12-04 10:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 9152002f-8509-5dfc-8979-17e1975e2490
2025-12-04 10:09:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003591726-01983844-002.pdf)
2025-12-04 10:09:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003591726-01983844-002.pdf)
2025-12-04 10:09:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3eab9e01-1605-468d-b573-23f340fb09cb_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003603120-01980610-002.pdf)
2025-12-04 10:09:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7f84569-fb89-55b3-a802-892df2beffaa with identifier: 358707
2025-12-04 10:09:16 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item a7f84569-fb89-55b3-a802-892df2beffaa
2025-12-04 10:09:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccce5110>
2025-12-04 10:09:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:09:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d428e59-cadd-5753-a5bf-34918c220e1e/8d428e59-cadd-5753-a5bf-34918c220e1e_image_19.jpg HTTP/1.1" 201 0
2025-12-04 10:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-233754-4007445-1005.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-233754-4007445-1005.jpg saved to cache
2025-12-04 10:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 8d428e59-cadd-5753-a5bf-34918c220e1e
2025-12-04 10:09:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc698c10>
2025-12-04 10:09:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:09:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_8.jpg HTTP/1.1" 201 0
2025-12-04 10:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F69318400-e473-4540-89a8-86cb0408a9cf_9.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_9.jpg saved to cache
2025-12-04 10:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9152002f-8509-5dfc-8979-17e1975e2490
2025-12-04 10:09:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cccb9850>
2025-12-04 10:09:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:09:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03/e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03_image_8.jpg HTTP/1.1" 201 0
2025-12-04 10:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3eab9e01-1605-468d-b573-23f340fb09cb_9.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3eab9e01-1605-468d-b573-23f340fb09cb_9.jpg saved to cache
2025-12-04 10:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03
2025-12-04 10:09:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc69a490>
2025-12-04 10:09:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:09:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03/e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03_image_9.jpg HTTP/1.1" 201 0
2025-12-04 10:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3eab9e01-1605-468d-b573-23f340fb09cb_ext_2.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3eab9e01-1605-468d-b573-23f340fb09cb_ext_2.jpg saved to cache
2025-12-04 10:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03
2025-12-04 10:09:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccffc450>
2025-12-04 10:09:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:09:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03/e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03_image_7.jpg HTTP/1.1" 201 0
2025-12-04 10:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3eab9e01-1605-468d-b573-23f340fb09cb_10.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3eab9e01-1605-468d-b573-23f340fb09cb_10.jpg saved to cache
2025-12-04 10:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03
2025-12-04 10:09:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf9d410>
2025-12-04 10:09:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 10:09:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_7.jpg HTTP/1.1" 201 0
2025-12-04 10:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F69318400-e473-4540-89a8-86cb0408a9cf_10.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_10.jpg saved to cache
2025-12-04 10:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9152002f-8509-5dfc-8979-17e1975e2490
2025-12-04 10:09:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-233754-4007445-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000233754-01989638-001.pdf)
2025-12-04 10:09:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003591726-01983844-002.pdf)
2025-12-04 10:09:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-233754-4007445-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000233754-01989638-001.pdf)
2025-12-04 10:09:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003591726-01983844-002.pdf)
2025-12-04 10:09:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3eab9e01-1605-468d-b573-23f340fb09cb_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003603120-01980610-002.pdf)
2025-12-04 10:09:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3eab9e01-1605-468d-b573-23f340fb09cb_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003603120-01980610-002.pdf)
2025-12-04 10:09:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-233754-4007445-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000233754-01989638-001.pdf)
2025-12-04 10:09:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccfb3a90>
2025-12-04 10:09:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:09:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_9.jpg HTTP/1.1" 201 0
2025-12-04 10:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F69318400-e473-4540-89a8-86cb0408a9cf_ext_2.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_ext_2.jpg saved to cache
2025-12-04 10:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9152002f-8509-5dfc-8979-17e1975e2490
2025-12-04 10:09:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6fe890>
2025-12-04 10:09:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:09:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_6.jpg HTTP/1.1" 201 0
2025-12-04 10:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F69318400-e473-4540-89a8-86cb0408a9cf_11.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_11.jpg saved to cache
2025-12-04 10:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9152002f-8509-5dfc-8979-17e1975e2490
2025-12-04 10:09:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc60be50>
2025-12-04 10:09:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:09:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03/e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03_image_6.jpg HTTP/1.1" 201 0
2025-12-04 10:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3eab9e01-1605-468d-b573-23f340fb09cb_11.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3eab9e01-1605-468d-b573-23f340fb09cb_11.jpg saved to cache
2025-12-04 10:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03
2025-12-04 10:09:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3eab9e01-1605-468d-b573-23f340fb09cb_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003603120-01980610-002.pdf)
2025-12-04 10:09:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-233754-4007445-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000233754-01989638-001.pdf)
2025-12-04 10:09:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003591726-01983844-002.pdf)
2025-12-04 10:09:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3eab9e01-1605-468d-b573-23f340fb09cb_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003603120-01980610-002.pdf)
2025-12-04 10:09:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccca4cd0>
2025-12-04 10:09:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:09:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d428e59-cadd-5753-a5bf-34918c220e1e/8d428e59-cadd-5753-a5bf-34918c220e1e_image_18.jpg HTTP/1.1" 201 0
2025-12-04 10:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-233754-4007445-1004.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-233754-4007445-1004.jpg saved to cache
2025-12-04 10:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 8d428e59-cadd-5753-a5bf-34918c220e1e
2025-12-04 10:09:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cccb3390>
2025-12-04 10:09:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:09:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_4.jpg HTTP/1.1" 201 0
2025-12-04 10:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F69318400-e473-4540-89a8-86cb0408a9cf_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_5.jpg saved to cache
2025-12-04 10:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9152002f-8509-5dfc-8979-17e1975e2490
2025-12-04 10:09:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccca5c10>
2025-12-04 10:09:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:09:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d428e59-cadd-5753-a5bf-34918c220e1e/8d428e59-cadd-5753-a5bf-34918c220e1e_image_16.jpg HTTP/1.1" 201 0
2025-12-04 10:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-233754-4007445-1002.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-233754-4007445-1002.jpg saved to cache
2025-12-04 10:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 8d428e59-cadd-5753-a5bf-34918c220e1e
2025-12-04 10:09:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6e0fd0>
2025-12-04 10:09:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:09:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_5.jpg HTTP/1.1" 201 0
2025-12-04 10:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F69318400-e473-4540-89a8-86cb0408a9cf_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_4.jpg saved to cache
2025-12-04 10:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9152002f-8509-5dfc-8979-17e1975e2490
2025-12-04 10:09:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5a0f10>
2025-12-04 10:09:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:09:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03/e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03_image_5.jpg HTTP/1.1" 201 0
2025-12-04 10:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3eab9e01-1605-468d-b573-23f340fb09cb_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3eab9e01-1605-468d-b573-23f340fb09cb_4.jpg saved to cache
2025-12-04 10:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03
2025-12-04 10:09:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce85dd0>
2025-12-04 10:09:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:09:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03/e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03_image_4.jpg HTTP/1.1" 201 0
2025-12-04 10:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3eab9e01-1605-468d-b573-23f340fb09cb_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3eab9e01-1605-468d-b573-23f340fb09cb_5.jpg saved to cache
2025-12-04 10:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03
2025-12-04 10:09:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc7cb8d0>
2025-12-04 10:09:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:09:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d428e59-cadd-5753-a5bf-34918c220e1e/8d428e59-cadd-5753-a5bf-34918c220e1e_image_17.jpg HTTP/1.1" 201 0
2025-12-04 10:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-233754-4007445-1003.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-233754-4007445-1003.jpg saved to cache
2025-12-04 10:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 8d428e59-cadd-5753-a5bf-34918c220e1e
2025-12-04 10:09:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/NISSAN/MICRA?id=3571047&returnUrl=%2Fsearch%3FPage%3D4%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233571047&indx=302> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 10:09:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc7dce10>
2025-12-04 10:09:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:09:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03/e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03_image_3.jpg HTTP/1.1" 201 0
2025-12-04 10:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3eab9e01-1605-468d-b573-23f340fb09cb_ext_1.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3eab9e01-1605-468d-b573-23f340fb09cb_ext_1.jpg saved to cache
2025-12-04 10:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03
2025-12-04 10:09:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc651ed0>
2025-12-04 10:09:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:09:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d428e59-cadd-5753-a5bf-34918c220e1e/8d428e59-cadd-5753-a5bf-34918c220e1e_image_15.jpg HTTP/1.1" 201 0
2025-12-04 10:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-233754-4007445-1001.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-233754-4007445-1001.jpg saved to cache
2025-12-04 10:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 8d428e59-cadd-5753-a5bf-34918c220e1e
2025-12-04 10:09:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc7dc090>
2025-12-04 10:09:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:09:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_3.jpg HTTP/1.1" 201 0
2025-12-04 10:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F69318400-e473-4540-89a8-86cb0408a9cf_ext_1.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_ext_1.jpg saved to cache
2025-12-04 10:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9152002f-8509-5dfc-8979-17e1975e2490
2025-12-04 10:09:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5cc690>
2025-12-04 10:09:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:09:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03/e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03_image_2.jpg HTTP/1.1" 201 0
2025-12-04 10:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3eab9e01-1605-468d-b573-23f340fb09cb_ext_6.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3eab9e01-1605-468d-b573-23f340fb09cb_ext_6.jpg saved to cache
2025-12-04 10:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03
2025-12-04 10:09:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-233754-4007445-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000233754-01989638-001.pdf)
2025-12-04 10:09:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3eab9e01-1605-468d-b573-23f340fb09cb_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003603120-01980610-002.pdf)
2025-12-04 10:09:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003591726-01983844-002.pdf)
2025-12-04 10:09:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3eab9e01-1605-468d-b573-23f340fb09cb_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003603120-01980610-002.pdf)
2025-12-04 10:09:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003591726-01983844-002.pdf)
2025-12-04 10:09:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-233754-4007445-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000233754-01989638-001.pdf)
2025-12-04 10:09:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/44dfdf9f-cdb5-4a4b-8530-eb77fd6d32c7_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000233754-01989638-001.pdf)
2025-12-04 10:09:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003591726-01983844-002.pdf)
2025-12-04 10:09:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f with identifier: 3571047
2025-12-04 10:09:21 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f
2025-12-04 10:09:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003586152-01984713-003.pdf> (referer: None)
2025-12-04 10:09:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0000358707-01985076-002.pdf> (referer: None)
2025-12-04 10:09:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cceb27d0>
2025-12-04 10:09:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:09:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d428e59-cadd-5753-a5bf-34918c220e1e/8d428e59-cadd-5753-a5bf-34918c220e1e_image_14.jpg HTTP/1.1" 201 0
2025-12-04 10:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-233754-4007445-1000.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-233754-4007445-1000.jpg saved to cache
2025-12-04 10:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 8d428e59-cadd-5753-a5bf-34918c220e1e
2025-12-04 10:09:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc54f850>
2025-12-04 10:09:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:09:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03/e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03_image_1.jpg HTTP/1.1" 201 0
2025-12-04 10:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3eab9e01-1605-468d-b573-23f340fb09cb_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3eab9e01-1605-468d-b573-23f340fb09cb_ext_7.jpg saved to cache
2025-12-04 10:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03
2025-12-04 10:09:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6f0a90>
2025-12-04 10:09:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:09:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_1.jpg HTTP/1.1" 201 0
2025-12-04 10:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F69318400-e473-4540-89a8-86cb0408a9cf_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_ext_7.jpg saved to cache
2025-12-04 10:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9152002f-8509-5dfc-8979-17e1975e2490
2025-12-04 10:09:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd0c91d0>
2025-12-04 10:09:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:09:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03/e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03_image_0.jpg HTTP/1.1" 201 0
2025-12-04 10:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3eab9e01-1605-468d-b573-23f340fb09cb_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3eab9e01-1605-468d-b573-23f340fb09cb_ext_7.jpg saved to cache
2025-12-04 10:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03
2025-12-04 10:09:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03, skipping ID generation
2025-12-04 10:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03 from tracking dictionaries
2025-12-04 10:09:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03 sending to next pipeline
2025-12-04 10:09:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03, identifier: 3603120
2025-12-04 10:09:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd0c1d50>
2025-12-04 10:09:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:09:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_2.jpg HTTP/1.1" 201 0
2025-12-04 10:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F69318400-e473-4540-89a8-86cb0408a9cf_ext_6.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_ext_6.jpg saved to cache
2025-12-04 10:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9152002f-8509-5dfc-8979-17e1975e2490
2025-12-04 10:09:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd4b7d0>
2025-12-04 10:09:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:09:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d428e59-cadd-5753-a5bf-34918c220e1e/8d428e59-cadd-5753-a5bf-34918c220e1e_image_13.jpg HTTP/1.1" 201 0
2025-12-04 10:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-233754-4007445-13.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-233754-4007445-13.jpg saved to cache
2025-12-04 10:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 8d428e59-cadd-5753-a5bf-34918c220e1e
2025-12-04 10:09:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccfe3e10>
2025-12-04 10:09:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:09:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d428e59-cadd-5753-a5bf-34918c220e1e/8d428e59-cadd-5753-a5bf-34918c220e1e_image_12.jpg HTTP/1.1" 201 0
2025-12-04 10:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F44dfdf9f-cdb5-4a4b-8530-eb77fd6d32c7_ext_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/44dfdf9f-cdb5-4a4b-8530-eb77fd6d32c7_ext_4.jpg saved to cache
2025-12-04 10:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 8d428e59-cadd-5753-a5bf-34918c220e1e
2025-12-04 10:09:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce13590>
2025-12-04 10:09:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:09:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_0.jpg HTTP/1.1" 201 0
2025-12-04 10:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F69318400-e473-4540-89a8-86cb0408a9cf_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_ext_7.jpg saved to cache
2025-12-04 10:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9152002f-8509-5dfc-8979-17e1975e2490
2025-12-04 10:09:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9152002f-8509-5dfc-8979-17e1975e2490, skipping ID generation
2025-12-04 10:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 9152002f-8509-5dfc-8979-17e1975e2490 from tracking dictionaries
2025-12-04 10:09:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9152002f-8509-5dfc-8979-17e1975e2490 sending to next pipeline
2025-12-04 10:09:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 9152002f-8509-5dfc-8979-17e1975e2490, identifier: 3591726
2025-12-04 10:09:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc595050>
2025-12-04 10:09:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:09:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_962271fe-0bbf-54ca-9150-79ce7988e6d2/962271fe-0bbf-54ca-9150-79ce7988e6d2_expert_report_file_6fbb0748-7563-4d4d-ade5-dbd21bc55068.pdf HTTP/1.1" 201 0
2025-12-04 10:09:24 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 962271fe-0bbf-54ca-9150-79ce7988e6d2
2025-12-04 10:09:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 962271fe-0bbf-54ca-9150-79ce7988e6d2, skipping ID generation
2025-12-04 10:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 962271fe-0bbf-54ca-9150-79ce7988e6d2
2025-12-04 10:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe9857e45-5435-4551-8081-6777c7e1be35_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e9857e45-5435-4551-8081-6777c7e1be35_ext_7.jpg not downloaded yet
2025-12-04 10:09:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd078350>
2025-12-04 10:09:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:09:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7f84569-fb89-55b3-a802-892df2beffaa/a7f84569-fb89-55b3-a802-892df2beffaa_expert_report_file_edec9391-2796-4fc0-93e3-fea54c442497.pdf HTTP/1.1" 201 0
2025-12-04 10:09:25 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item a7f84569-fb89-55b3-a802-892df2beffaa
2025-12-04 10:09:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a7f84569-fb89-55b3-a802-892df2beffaa, skipping ID generation
2025-12-04 10:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item a7f84569-fb89-55b3-a802-892df2beffaa
2025-12-04 10:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa6af1569-55dc-4d66-88da-768b58bbe966_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a6af1569-55dc-4d66-88da-768b58bbe966_ext_7.jpg not downloaded yet
2025-12-04 10:09:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/44dfdf9f-cdb5-4a4b-8530-eb77fd6d32c7_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000233754-01989638-001.pdf)
2025-12-04 10:09:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03 with identifier: 3603120
2025-12-04 10:09:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03 with identifier: 3603120
2025-12-04 10:09:25 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03 with identifier: 3603120 to the API
2025-12-04 10:09:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 10:09:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 10:09:25 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/3eab9e01-1605-468d-b573-23f340fb09cb_ext_7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03/e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03_expert_report_file_ed362e2e-f8c3-4f19-be89-c8734a5e4076.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003603120-01980610-002.pdf',
 'color': 'RED',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'DY71XTK',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MAZDA/3?id=3603120',
 'listing': 'auction',
 'location': 'Leeds',
 'make': 'MAZDA',
 'model': '3',
 'odometer': 70161,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 64,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03/e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 209433,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3eab9e01-1605-468d-b573-23f340fb09cb_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03/e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 209433,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3eab9e01-1605-468d-b573-23f340fb09cb_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03/e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 238745,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3eab9e01-1605-468d-b573-23f340fb09cb_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03/e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 195049,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3eab9e01-1605-468d-b573-23f340fb09cb_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03/e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 205254,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3eab9e01-1605-468d-b573-23f340fb09cb_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03/e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 199419,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3eab9e01-1605-468d-b573-23f340fb09cb_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03/e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 217003,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3eab9e01-1605-468d-b573-23f340fb09cb_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03/e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 211132,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3eab9e01-1605-468d-b573-23f340fb09cb_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03/e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 211262,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3eab9e01-1605-468d-b573-23f340fb09cb_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03/e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 243038,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3eab9e01-1605-468d-b573-23f340fb09cb_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03/e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 246420,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3eab9e01-1605-468d-b573-23f340fb09cb_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03/e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 221270,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3eab9e01-1605-468d-b573-23f340fb09cb_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03/e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 242111,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3eab9e01-1605-468d-b573-23f340fb09cb_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03/e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 248925,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3603120-3999879-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03/e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 313672,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3603120-3999879-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03/e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 278549,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3603120-3999879-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03/e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 206498,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3603120-3999879-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03/e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 280205,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3603120-3999879-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03/e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 175390,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3603120-3999879-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03/e9a73c0d-e0fa-5374-abdb-91fb3d7d2f03_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 205950,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3603120-3999879-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-30',
 'seller_name': 'Leasys',
 'title': 'MAZDA 3 2.0 e-Skyactiv G MHEV Sport Lux 5dr Auto',
 'transmission': 'automatic',
 'trim': '2.0 e-Skyactiv G MHEV Sport Lux 5dr Auto',
 'year': 2021}
2025-12-04 10:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273603120%27 HTTP/1.1" 200 None
2025-12-04 10:09:25 [manheim.gb] INFO: Saving data for 3603120: {'created_time': 1764842965.557313, 'last_price_update_time': 1764842965.557323, 'auction_closing_time': 1765184400.0}
2025-12-04 10:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3603120') HTTP/1.1" 204 0
2025-12-04 10:09:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 9152002f-8509-5dfc-8979-17e1975e2490 with identifier: 3591726
2025-12-04 10:09:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 9152002f-8509-5dfc-8979-17e1975e2490 with identifier: 3591726
2025-12-04 10:09:25 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 30, 'seller_name': 'novuna vehicle solutions', 'price_includes_vat': False, 'title': 'mercedes-benz e220 eqc 400 300kw amg line premium 80kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'mercedes-benz', 'model': 'e220', 'transmission': 'automatic', 'engine': '0.0l', 'fuel_type': 'electric', 'odometer': 50858, 'odometer_reading_unit': 'mi', 'registration_date': '2021-10-20', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/mercedes-benz/e220?id=3591726', 'location': 'leeds - in transit', 'origin_country_code': 'gb', 'trim': 'eqc 400 300kw amg line premium 80kwh 5dr auto', 'license_plate': 'ov71jwk', 'year': 2021, 'listing': 'auction', 'c_o_2_emission_value': 0, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0003591726-01983844-002.pdf', 'expiration_date': '2025-12-08t09:00:00z', 'is_vat_deductible': True, 'is_vat_included': False, 'id': '9152002f-8509-5dfc-8979-17e1975e2490', 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_expert_report_file_62075d27-45d1-457d-b8b5-f904d6cfe288.pdf', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_0.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_ext_7.jpg', 'Width': 1499, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 199734}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_1.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_ext_7.jpg', 'Width': 1499, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 199734}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_2.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_ext_6.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 238956}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_3.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_ext_1.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 208086}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_4.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_5.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 184284}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_5.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_4.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 199945}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_6.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_11.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 185701}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_7.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_10.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 196940}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_8.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_9.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 215225}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_9.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_ext_2.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 301644}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_10.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_ext_5.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 242535}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_11.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_ext_3.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 228925}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_12.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_ext_4.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 227697}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_13.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3591726-4003111-13.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 485626}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_14.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3591726-4003111-1000.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 428949}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_15.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3591726-4003111-1001.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 463846}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_16.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3591726-4003111-1002.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 498408}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_17.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3591726-4003111-1003.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 268082}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_18.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3591726-4003111-1004.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 276741}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_19.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3591726-4003111-1005.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 494243}], 'current_year_diff': 4, 'age_in_months': 49, 'make_model': 'mercedes-benz e220', 'sanitized_make': 'mercedesbenz', 'odometer_in_km': 81847} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 49,
     'auction_title': '',
     'c_o_2_emission_value': 0,
     'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_expert_report_file_62075d27-45d1-457d-b8b5-f904d6cfe288.pdf',
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0003591726-01983844-002.pdf',
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 4,
     'engine': '0.0l',
     'expiration_date': '2025-12-08t09:00:00z',
     'fuel_type': 'electric',
     'id': '9152002f-8509-5dfc-8979-17e1975e2490',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'ov71jwk',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/mercedes-benz/e220?id=3591726',
     'listing': 'auction',
     'location': 'leeds - in transit',
     'make': 'mercedes-benz',
     'make_model': 'mercedes-benz e220',
     'model': 'e220',
     'odometer': 50858,
     'odometer_in_km': 81847,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 30,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 199734,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_ext_7.jpg',
                 'Width': 1499},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 199734,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_ext_7.jpg',
                 'Width': 1499},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 238956,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_ext_6.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 208086,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_ext_1.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 184284,
                 'Height': 999,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_5.jpg',
                 'Width': 1500},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 199945,
                 'Height': 999,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_4.jpg',
                 'Width': 1500},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 185701,
                 'Height': 999,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_11.jpg',
                 'Width': 1500},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 196940,
                 'Height': 999,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_10.jpg',
                 'Width': 1500},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 215225,
                 'Height': 999,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_9.jpg',
                 'Width': 1500},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 301644,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_ext_2.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 242535,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_ext_5.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 228925,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_ext_3.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 227697,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_ext_4.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 485626,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3591726-4003111-13.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 428949,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3591726-4003111-1000.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_15.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 463846,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3591726-4003111-1001.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_16.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 498408,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3591726-4003111-1002.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_17.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 268082,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3591726-4003111-1003.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_18.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 276741,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3591726-4003111-1004.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_19.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 494243,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3591726-4003111-1005.jpg',
                 'Width': 1333}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-10-20',
     'sanitized_make': 'mercedesbenz',
     'seller_name': 'novuna vehicle solutions',
     'title': 'mercedes-benz e220 eqc 400 300kw amg line premium 80kwh 5dr '
              'auto',
     'transmission': 'automatic',
     'trim': 'eqc 400 300kw amg line premium 80kwh 5dr auto',
     'year': 2021}
2025-12-04 10:09:25 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 9152002f-8509-5dfc-8979-17e1975e2490 spider: manheim.gb
2025-12-04 10:09:25 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 9152002f-8509-5dfc-8979-17e1975e2490 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 30, 'seller_name': 'novuna vehicle solutions', 'price_includes_vat': False, 'title': 'mercedes-benz e220 eqc 400 300kw amg line premium 80kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'mercedes-benz', 'model': 'e220', 'transmission': 'automatic', 'engine': '0.0l', 'fuel_type': 'electric', 'odometer': 50858, 'odometer_reading_unit': 'mi', 'registration_date': '2021-10-20', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/mercedes-benz/e220?id=3591726', 'location': 'leeds - in transit', 'origin_country_code': 'gb', 'trim': 'eqc 400 300kw amg line premium 80kwh 5dr auto', 'license_plate': 'ov71jwk', 'year': 2021, 'listing': 'auction', 'c_o_2_emission_value': 0, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0003591726-01983844-002.pdf', 'expiration_date': '2025-12-08t09:00:00z', 'is_vat_deductible': True, 'is_vat_included': False, 'id': '9152002f-8509-5dfc-8979-17e1975e2490', 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_expert_report_file_62075d27-45d1-457d-b8b5-f904d6cfe288.pdf', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_0.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_ext_7.jpg', 'Width': 1499, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 199734}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_1.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_ext_7.jpg', 'Width': 1499, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 199734}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_2.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_ext_6.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 238956}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_3.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_ext_1.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 208086}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_4.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_5.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 184284}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_5.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_4.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 199945}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_6.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_11.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 185701}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_7.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_10.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 196940}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_8.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_9.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 215225}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_9.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_ext_2.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 301644}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_10.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_ext_5.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 242535}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_11.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_ext_3.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 228925}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_12.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_ext_4.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 227697}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_13.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3591726-4003111-13.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 485626}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_14.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3591726-4003111-1000.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 428949}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_15.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3591726-4003111-1001.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 463846}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_16.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3591726-4003111-1002.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 498408}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_17.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3591726-4003111-1003.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 268082}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_18.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3591726-4003111-1004.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 276741}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_19.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3591726-4003111-1005.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 494243}], 'current_year_diff': 4, 'age_in_months': 49, 'make_model': 'mercedes-benz e220', 'sanitized_make': 'mercedesbenz', 'odometer_in_km': 81847} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 49,
     'auction_title': '',
     'c_o_2_emission_value': 0,
     'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_expert_report_file_62075d27-45d1-457d-b8b5-f904d6cfe288.pdf',
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0003591726-01983844-002.pdf',
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 4,
     'engine': '0.0l',
     'expiration_date': '2025-12-08t09:00:00z',
     'fuel_type': 'electric',
     'id': '9152002f-8509-5dfc-8979-17e1975e2490',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'ov71jwk',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/mercedes-benz/e220?id=3591726',
     'listing': 'auction',
     'location': 'leeds - in transit',
     'make': 'mercedes-benz',
     'make_model': 'mercedes-benz e220',
     'model': 'e220',
     'odometer': 50858,
     'odometer_in_km': 81847,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 30,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 199734,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_ext_7.jpg',
                 'Width': 1499},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 199734,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_ext_7.jpg',
                 'Width': 1499},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 238956,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_ext_6.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 208086,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_ext_1.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 184284,
                 'Height': 999,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_5.jpg',
                 'Width': 1500},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 199945,
                 'Height': 999,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_4.jpg',
                 'Width': 1500},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 185701,
                 'Height': 999,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_11.jpg',
                 'Width': 1500},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 196940,
                 'Height': 999,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_10.jpg',
                 'Width': 1500},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 215225,
                 'Height': 999,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_9.jpg',
                 'Width': 1500},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 301644,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_ext_2.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 242535,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_ext_5.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 228925,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_ext_3.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 227697,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_ext_4.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 485626,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3591726-4003111-13.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 428949,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3591726-4003111-1000.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_15.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 463846,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3591726-4003111-1001.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_16.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 498408,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3591726-4003111-1002.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_17.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 268082,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3591726-4003111-1003.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_18.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 276741,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3591726-4003111-1004.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_19.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 494243,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3591726-4003111-1005.jpg',
                 'Width': 1333}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-10-20',
     'sanitized_make': 'mercedesbenz',
     'seller_name': 'novuna vehicle solutions',
     'title': 'mercedes-benz e220 eqc 400 300kw amg line premium 80kwh 5dr '
              'auto',
     'transmission': 'automatic',
     'trim': 'eqc 400 300kw amg line premium 80kwh 5dr auto',
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_expert_report_file_62075d27-45d1-457d-b8b5-f904d6cfe288.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003591726-01983844-002.pdf',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '0.0L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Electric',
 'id': '9152002f-8509-5dfc-8979-17e1975e2490',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'OV71JWK',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/E220?id=3591726',
 'listing': 'auction',
 'location': 'Leeds - In Transit',
 'make': 'MERCEDES-BENZ',
 'model': 'E220',
 'odometer': 50858,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 30,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 199734,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 199734,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 238956,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 208086,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 184284,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_5.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 199945,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_4.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 185701,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_11.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 196940,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_10.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 215225,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_9.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 301644,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 242535,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 228925,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 227697,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69318400-e473-4540-89a8-86cb0408a9cf_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 485626,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3591726-4003111-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 428949,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3591726-4003111-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 463846,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3591726-4003111-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 498408,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3591726-4003111-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 268082,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3591726-4003111-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 276741,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3591726-4003111-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9152002f-8509-5dfc-8979-17e1975e2490/9152002f-8509-5dfc-8979-17e1975e2490_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 494243,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3591726-4003111-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-20',
 'seller_name': 'Novuna Vehicle Solutions',
 'title': 'MERCEDES-BENZ E220 EQC 400 300kW AMG Line Premium 80kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': 'EQC 400 300kW AMG Line Premium 80kWh 5dr Auto',
 'year': 2021}
2025-12-04 10:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273591726%27 HTTP/1.1" 200 None
2025-12-04 10:09:25 [manheim.gb] INFO: Saving data for 3591726: {'created_time': 1764842965.799348, 'last_price_update_time': 1764842965.799359, 'auction_closing_time': 1765184400.0}
2025-12-04 10:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3591726') HTTP/1.1" 204 0
2025-12-04 10:09:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/44dfdf9f-cdb5-4a4b-8530-eb77fd6d32c7_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000233754-01989638-001.pdf)
2025-12-04 10:09:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/44dfdf9f-cdb5-4a4b-8530-eb77fd6d32c7_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000233754-01989638-001.pdf)
2025-12-04 10:09:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/44dfdf9f-cdb5-4a4b-8530-eb77fd6d32c7_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000233754-01989638-001.pdf)
2025-12-04 10:09:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/44dfdf9f-cdb5-4a4b-8530-eb77fd6d32c7_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000233754-01989638-001.pdf)
2025-12-04 10:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe9857e45-5435-4551-8081-6777c7e1be35_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e9857e45-5435-4551-8081-6777c7e1be35_ext_7.jpg not downloaded yet
2025-12-04 10:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa6af1569-55dc-4d66-88da-768b58bbe966_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a6af1569-55dc-4d66-88da-768b58bbe966_ext_7.jpg not downloaded yet
2025-12-04 10:09:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/44dfdf9f-cdb5-4a4b-8530-eb77fd6d32c7_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000233754-01989638-001.pdf)
2025-12-04 10:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe9857e45-5435-4551-8081-6777c7e1be35_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e9857e45-5435-4551-8081-6777c7e1be35_ext_6.jpg not downloaded yet
2025-12-04 10:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa6af1569-55dc-4d66-88da-768b58bbe966_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a6af1569-55dc-4d66-88da-768b58bbe966_ext_6.jpg not downloaded yet
2025-12-04 10:09:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccc51ed0>
2025-12-04 10:09:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:09:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d428e59-cadd-5753-a5bf-34918c220e1e/8d428e59-cadd-5753-a5bf-34918c220e1e_image_11.jpg HTTP/1.1" 201 0
2025-12-04 10:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F44dfdf9f-cdb5-4a4b-8530-eb77fd6d32c7_ext_3.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/44dfdf9f-cdb5-4a4b-8530-eb77fd6d32c7_ext_3.jpg saved to cache
2025-12-04 10:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 8d428e59-cadd-5753-a5bf-34918c220e1e
2025-12-04 10:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe9857e45-5435-4551-8081-6777c7e1be35_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e9857e45-5435-4551-8081-6777c7e1be35_ext_1.jpg not downloaded yet
2025-12-04 10:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa6af1569-55dc-4d66-88da-768b58bbe966_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a6af1569-55dc-4d66-88da-768b58bbe966_ext_1.jpg not downloaded yet
2025-12-04 10:09:26 [scrapy.extensions.logstats] INFO: Crawled 161 pages (at 18 pages/min), scraped 44 items (at 5 items/min)
2025-12-04 10:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe9857e45-5435-4551-8081-6777c7e1be35_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e9857e45-5435-4551-8081-6777c7e1be35_5.jpg not downloaded yet
2025-12-04 10:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa6af1569-55dc-4d66-88da-768b58bbe966_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a6af1569-55dc-4d66-88da-768b58bbe966_5.jpg not downloaded yet
2025-12-04 10:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe9857e45-5435-4551-8081-6777c7e1be35_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e9857e45-5435-4551-8081-6777c7e1be35_4.jpg not downloaded yet
2025-12-04 10:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa6af1569-55dc-4d66-88da-768b58bbe966_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a6af1569-55dc-4d66-88da-768b58bbe966_4.jpg not downloaded yet
2025-12-04 10:09:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc71bd10>
2025-12-04 10:09:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:09:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d428e59-cadd-5753-a5bf-34918c220e1e/8d428e59-cadd-5753-a5bf-34918c220e1e_image_9.jpg HTTP/1.1" 201 0
2025-12-04 10:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F44dfdf9f-cdb5-4a4b-8530-eb77fd6d32c7_ext_2.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/44dfdf9f-cdb5-4a4b-8530-eb77fd6d32c7_ext_2.jpg saved to cache
2025-12-04 10:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8d428e59-cadd-5753-a5bf-34918c220e1e
2025-12-04 10:09:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc694910>
2025-12-04 10:09:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:09:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d428e59-cadd-5753-a5bf-34918c220e1e/8d428e59-cadd-5753-a5bf-34918c220e1e_image_8.jpg HTTP/1.1" 201 0
2025-12-04 10:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F44dfdf9f-cdb5-4a4b-8530-eb77fd6d32c7_9.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/44dfdf9f-cdb5-4a4b-8530-eb77fd6d32c7_9.jpg saved to cache
2025-12-04 10:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8d428e59-cadd-5753-a5bf-34918c220e1e
2025-12-04 10:09:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc571b10>
2025-12-04 10:09:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:09:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d428e59-cadd-5753-a5bf-34918c220e1e/8d428e59-cadd-5753-a5bf-34918c220e1e_image_6.jpg HTTP/1.1" 201 0
2025-12-04 10:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F44dfdf9f-cdb5-4a4b-8530-eb77fd6d32c7_11.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/44dfdf9f-cdb5-4a4b-8530-eb77fd6d32c7_11.jpg saved to cache
2025-12-04 10:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8d428e59-cadd-5753-a5bf-34918c220e1e
2025-12-04 10:09:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc695e10>
2025-12-04 10:09:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:09:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d428e59-cadd-5753-a5bf-34918c220e1e/8d428e59-cadd-5753-a5bf-34918c220e1e_image_10.jpg HTTP/1.1" 201 0
2025-12-04 10:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F44dfdf9f-cdb5-4a4b-8530-eb77fd6d32c7_ext_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/44dfdf9f-cdb5-4a4b-8530-eb77fd6d32c7_ext_5.jpg saved to cache
2025-12-04 10:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 8d428e59-cadd-5753-a5bf-34918c220e1e
2025-12-04 10:09:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc71a0d0>
2025-12-04 10:09:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:09:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d428e59-cadd-5753-a5bf-34918c220e1e/8d428e59-cadd-5753-a5bf-34918c220e1e_image_7.jpg HTTP/1.1" 201 0
2025-12-04 10:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F44dfdf9f-cdb5-4a4b-8530-eb77fd6d32c7_10.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/44dfdf9f-cdb5-4a4b-8530-eb77fd6d32c7_10.jpg saved to cache
2025-12-04 10:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8d428e59-cadd-5753-a5bf-34918c220e1e
2025-12-04 10:09:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8d428e59-cadd-5753-a5bf-34918c220e1e, skipping ID generation
2025-12-04 10:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 8d428e59-cadd-5753-a5bf-34918c220e1e from tracking dictionaries
2025-12-04 10:09:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8d428e59-cadd-5753-a5bf-34918c220e1e sending to next pipeline
2025-12-04 10:09:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 8d428e59-cadd-5753-a5bf-34918c220e1e, identifier: 233754
2025-12-04 10:09:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 8d428e59-cadd-5753-a5bf-34918c220e1e with identifier: 233754
2025-12-04 10:09:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 8d428e59-cadd-5753-a5bf-34918c220e1e with identifier: 233754
2025-12-04 10:09:27 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 12 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    12
2025-12-04 10:09:27 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: 8d428e59-cadd-5753-a5bf-34918c220e1e spider: manheim.gb
2025-12-04 10:09:27 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 8d428e59-cadd-5753-a5bf-34918c220e1e due to rule: registration_date_old.json, error: 12 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    12
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d428e59-cadd-5753-a5bf-34918c220e1e/8d428e59-cadd-5753-a5bf-34918c220e1e_expert_report_file_35ea3dd8-e82a-4ef3-9997-337672ff54e4.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0000233754-01989638-001.pdf',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '8d428e59-cadd-5753-a5bf-34918c220e1e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'EU63YRP',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=233754',
 'listing': 'auction',
 'location': 'Shotts',
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 92199,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 38,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d428e59-cadd-5753-a5bf-34918c220e1e/8d428e59-cadd-5753-a5bf-34918c220e1e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 225397,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/44dfdf9f-cdb5-4a4b-8530-eb77fd6d32c7_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d428e59-cadd-5753-a5bf-34918c220e1e/8d428e59-cadd-5753-a5bf-34918c220e1e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 225397,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/44dfdf9f-cdb5-4a4b-8530-eb77fd6d32c7_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d428e59-cadd-5753-a5bf-34918c220e1e/8d428e59-cadd-5753-a5bf-34918c220e1e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 197189,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/44dfdf9f-cdb5-4a4b-8530-eb77fd6d32c7_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d428e59-cadd-5753-a5bf-34918c220e1e/8d428e59-cadd-5753-a5bf-34918c220e1e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 171619,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/44dfdf9f-cdb5-4a4b-8530-eb77fd6d32c7_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d428e59-cadd-5753-a5bf-34918c220e1e/8d428e59-cadd-5753-a5bf-34918c220e1e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 227905,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/44dfdf9f-cdb5-4a4b-8530-eb77fd6d32c7_5.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d428e59-cadd-5753-a5bf-34918c220e1e/8d428e59-cadd-5753-a5bf-34918c220e1e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 216309,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/44dfdf9f-cdb5-4a4b-8530-eb77fd6d32c7_4.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d428e59-cadd-5753-a5bf-34918c220e1e/8d428e59-cadd-5753-a5bf-34918c220e1e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 230566,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/44dfdf9f-cdb5-4a4b-8530-eb77fd6d32c7_11.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d428e59-cadd-5753-a5bf-34918c220e1e/8d428e59-cadd-5753-a5bf-34918c220e1e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 212756,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/44dfdf9f-cdb5-4a4b-8530-eb77fd6d32c7_10.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d428e59-cadd-5753-a5bf-34918c220e1e/8d428e59-cadd-5753-a5bf-34918c220e1e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 230007,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/44dfdf9f-cdb5-4a4b-8530-eb77fd6d32c7_9.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d428e59-cadd-5753-a5bf-34918c220e1e/8d428e59-cadd-5753-a5bf-34918c220e1e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 216319,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/44dfdf9f-cdb5-4a4b-8530-eb77fd6d32c7_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d428e59-cadd-5753-a5bf-34918c220e1e/8d428e59-cadd-5753-a5bf-34918c220e1e_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 171473,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/44dfdf9f-cdb5-4a4b-8530-eb77fd6d32c7_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d428e59-cadd-5753-a5bf-34918c220e1e/8d428e59-cadd-5753-a5bf-34918c220e1e_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 174943,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/44dfdf9f-cdb5-4a4b-8530-eb77fd6d32c7_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d428e59-cadd-5753-a5bf-34918c220e1e/8d428e59-cadd-5753-a5bf-34918c220e1e_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 215578,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/44dfdf9f-cdb5-4a4b-8530-eb77fd6d32c7_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d428e59-cadd-5753-a5bf-34918c220e1e/8d428e59-cadd-5753-a5bf-34918c220e1e_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 237753,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-233754-4007445-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d428e59-cadd-5753-a5bf-34918c220e1e/8d428e59-cadd-5753-a5bf-34918c220e1e_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 159873,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-233754-4007445-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d428e59-cadd-5753-a5bf-34918c220e1e/8d428e59-cadd-5753-a5bf-34918c220e1e_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 182826,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-233754-4007445-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d428e59-cadd-5753-a5bf-34918c220e1e/8d428e59-cadd-5753-a5bf-34918c220e1e_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 168847,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-233754-4007445-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d428e59-cadd-5753-a5bf-34918c220e1e/8d428e59-cadd-5753-a5bf-34918c220e1e_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 207542,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-233754-4007445-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d428e59-cadd-5753-a5bf-34918c220e1e/8d428e59-cadd-5753-a5bf-34918c220e1e_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 130035,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-233754-4007445-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d428e59-cadd-5753-a5bf-34918c220e1e/8d428e59-cadd-5753-a5bf-34918c220e1e_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 192653,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-233754-4007445-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-12',
 'seller_name': 'Parks Motor Group',
 'title': 'NISSAN QASHQAI 1.6 dCi 360 5dr [Start Stop]',
 'transmission': 'manual',
 'trim': '1.6 dCi 360 5dr [Start Stop]',
 'year': 2013}
2025-12-04 10:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27233754%27 HTTP/1.1" 200 None
2025-12-04 10:09:27 [manheim.gb] INFO: Saving data for 233754: {'created_time': 1764842967.747917, 'last_price_update_time': 1764842967.747928, 'auction_closing_time': 1765270800.0}
2025-12-04 10:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='233754') HTTP/1.1" 204 0
2025-12-04 10:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe9857e45-5435-4551-8081-6777c7e1be35_11.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e9857e45-5435-4551-8081-6777c7e1be35_11.jpg not downloaded yet
2025-12-04 10:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa6af1569-55dc-4d66-88da-768b58bbe966_11.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a6af1569-55dc-4d66-88da-768b58bbe966_11.jpg not downloaded yet
2025-12-04 10:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe9857e45-5435-4551-8081-6777c7e1be35_10.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e9857e45-5435-4551-8081-6777c7e1be35_10.jpg not downloaded yet
2025-12-04 10:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa6af1569-55dc-4d66-88da-768b58bbe966_10.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a6af1569-55dc-4d66-88da-768b58bbe966_10.jpg not downloaded yet
2025-12-04 10:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe9857e45-5435-4551-8081-6777c7e1be35_9.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e9857e45-5435-4551-8081-6777c7e1be35_9.jpg not downloaded yet
2025-12-04 10:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa6af1569-55dc-4d66-88da-768b58bbe966_9.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a6af1569-55dc-4d66-88da-768b58bbe966_9.jpg not downloaded yet
2025-12-04 10:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe9857e45-5435-4551-8081-6777c7e1be35_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e9857e45-5435-4551-8081-6777c7e1be35_ext_2.jpg not downloaded yet
2025-12-04 10:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa6af1569-55dc-4d66-88da-768b58bbe966_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a6af1569-55dc-4d66-88da-768b58bbe966_ext_2.jpg not downloaded yet
2025-12-04 10:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe9857e45-5435-4551-8081-6777c7e1be35_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e9857e45-5435-4551-8081-6777c7e1be35_ext_5.jpg not downloaded yet
2025-12-04 10:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa6af1569-55dc-4d66-88da-768b58bbe966_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a6af1569-55dc-4d66-88da-768b58bbe966_ext_5.jpg not downloaded yet
2025-12-04 10:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe9857e45-5435-4551-8081-6777c7e1be35_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e9857e45-5435-4551-8081-6777c7e1be35_ext_3.jpg not downloaded yet
2025-12-04 10:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa6af1569-55dc-4d66-88da-768b58bbe966_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a6af1569-55dc-4d66-88da-768b58bbe966_ext_3.jpg not downloaded yet
2025-12-04 10:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe9857e45-5435-4551-8081-6777c7e1be35_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e9857e45-5435-4551-8081-6777c7e1be35_ext_4.jpg not downloaded yet
2025-12-04 10:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa6af1569-55dc-4d66-88da-768b58bbe966_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a6af1569-55dc-4d66-88da-768b58bbe966_ext_4.jpg not downloaded yet
2025-12-04 10:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3586152-4001126-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3586152-4001126-13.jpg not downloaded yet
2025-12-04 10:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-358707-4006467-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-358707-4006467-13.jpg not downloaded yet
2025-12-04 10:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3586152-4001126-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3586152-4001126-1000.jpg not downloaded yet
2025-12-04 10:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-358707-4006467-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-358707-4006467-1000.jpg not downloaded yet
2025-12-04 10:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3586152-4001126-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3586152-4001126-1001.jpg not downloaded yet
2025-12-04 10:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-358707-4006467-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-358707-4006467-1001.jpg not downloaded yet
2025-12-04 10:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3586152-4001126-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3586152-4001126-1002.jpg not downloaded yet
2025-12-04 10:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-358707-4006467-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-358707-4006467-1002.jpg not downloaded yet
2025-12-04 10:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3586152-4001126-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3586152-4001126-1003.jpg not downloaded yet
2025-12-04 10:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-358707-4006467-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-358707-4006467-1003.jpg not downloaded yet
2025-12-04 10:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3586152-4001126-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3586152-4001126-1004.jpg not downloaded yet
2025-12-04 10:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-358707-4006467-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-358707-4006467-1004.jpg not downloaded yet
2025-12-04 10:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3586152-4001126-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3586152-4001126-1005.jpg not downloaded yet
2025-12-04 10:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-358707-4006467-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-358707-4006467-1005.jpg not downloaded yet
2025-12-04 10:09:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003571047-01943040-001.pdf> (referer: None)
2025-12-04 10:09:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccda4a10>
2025-12-04 10:09:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:09:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f/3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f_expert_report_file_fec6137e-01b6-428f-93fc-3d7816c3f85f.pdf HTTP/1.1" 201 0
2025-12-04 10:09:28 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f
2025-12-04 10:09:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f, skipping ID generation
2025-12-04 10:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f
2025-12-04 10:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fae7b19cc-e5bb-440c-8d81-5262cf48127c_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ae7b19cc-e5bb-440c-8d81-5262cf48127c_ext_7.jpg not downloaded yet
2025-12-04 10:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fae7b19cc-e5bb-440c-8d81-5262cf48127c_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ae7b19cc-e5bb-440c-8d81-5262cf48127c_ext_7.jpg not downloaded yet
2025-12-04 10:09:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-358707-4006467-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000358707-01985076-002.pdf)
2025-12-04 10:09:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-358707-4006467-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000358707-01985076-002.pdf)
2025-12-04 10:09:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3586152-4001126-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003586152-01984713-003.pdf)
2025-12-04 10:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fae7b19cc-e5bb-440c-8d81-5262cf48127c_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ae7b19cc-e5bb-440c-8d81-5262cf48127c_ext_6.jpg not downloaded yet
2025-12-04 10:09:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-358707-4006467-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000358707-01985076-002.pdf)
2025-12-04 10:09:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3586152-4001126-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003586152-01984713-003.pdf)
2025-12-04 10:09:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3586152-4001126-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003586152-01984713-003.pdf)
2025-12-04 10:09:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3586152-4001126-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003586152-01984713-003.pdf)
2025-12-04 10:09:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-358707-4006467-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000358707-01985076-002.pdf)
2025-12-04 10:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fae7b19cc-e5bb-440c-8d81-5262cf48127c_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ae7b19cc-e5bb-440c-8d81-5262cf48127c_ext_1.jpg not downloaded yet
2025-12-04 10:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fae7b19cc-e5bb-440c-8d81-5262cf48127c_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ae7b19cc-e5bb-440c-8d81-5262cf48127c_5.jpg not downloaded yet
2025-12-04 10:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fae7b19cc-e5bb-440c-8d81-5262cf48127c_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ae7b19cc-e5bb-440c-8d81-5262cf48127c_4.jpg not downloaded yet
2025-12-04 10:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fae7b19cc-e5bb-440c-8d81-5262cf48127c_11.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ae7b19cc-e5bb-440c-8d81-5262cf48127c_11.jpg not downloaded yet
2025-12-04 10:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fae7b19cc-e5bb-440c-8d81-5262cf48127c_10.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ae7b19cc-e5bb-440c-8d81-5262cf48127c_10.jpg not downloaded yet
2025-12-04 10:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fae7b19cc-e5bb-440c-8d81-5262cf48127c_9.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ae7b19cc-e5bb-440c-8d81-5262cf48127c_9.jpg not downloaded yet
2025-12-04 10:09:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc694850>
2025-12-04 10:09:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:09:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7f84569-fb89-55b3-a802-892df2beffaa/a7f84569-fb89-55b3-a802-892df2beffaa_image_19.jpg HTTP/1.1" 201 0
2025-12-04 10:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-358707-4006467-1005.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-358707-4006467-1005.jpg saved to cache
2025-12-04 10:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item a7f84569-fb89-55b3-a802-892df2beffaa
2025-12-04 10:09:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf0a990>
2025-12-04 10:09:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:09:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7f84569-fb89-55b3-a802-892df2beffaa/a7f84569-fb89-55b3-a802-892df2beffaa_image_18.jpg HTTP/1.1" 201 0
2025-12-04 10:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-358707-4006467-1004.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-358707-4006467-1004.jpg saved to cache
2025-12-04 10:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item a7f84569-fb89-55b3-a802-892df2beffaa
2025-12-04 10:09:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccfc15d0>
2025-12-04 10:09:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:09:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_962271fe-0bbf-54ca-9150-79ce7988e6d2/962271fe-0bbf-54ca-9150-79ce7988e6d2_image_17.jpg HTTP/1.1" 201 0
2025-12-04 10:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3586152-4001126-1003.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3586152-4001126-1003.jpg saved to cache
2025-12-04 10:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 962271fe-0bbf-54ca-9150-79ce7988e6d2
2025-12-04 10:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fae7b19cc-e5bb-440c-8d81-5262cf48127c_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ae7b19cc-e5bb-440c-8d81-5262cf48127c_ext_2.jpg not downloaded yet
2025-12-04 10:09:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc565790>
2025-12-04 10:09:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:09:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7f84569-fb89-55b3-a802-892df2beffaa/a7f84569-fb89-55b3-a802-892df2beffaa_image_17.jpg HTTP/1.1" 201 0
2025-12-04 10:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-358707-4006467-1003.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-358707-4006467-1003.jpg saved to cache
2025-12-04 10:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item a7f84569-fb89-55b3-a802-892df2beffaa
2025-12-04 10:09:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc590f90>
2025-12-04 10:09:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:09:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_962271fe-0bbf-54ca-9150-79ce7988e6d2/962271fe-0bbf-54ca-9150-79ce7988e6d2_image_19.jpg HTTP/1.1" 201 0
2025-12-04 10:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3586152-4001126-1005.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3586152-4001126-1005.jpg saved to cache
2025-12-04 10:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 962271fe-0bbf-54ca-9150-79ce7988e6d2
2025-12-04 10:09:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc590550>
2025-12-04 10:09:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:09:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_962271fe-0bbf-54ca-9150-79ce7988e6d2/962271fe-0bbf-54ca-9150-79ce7988e6d2_image_16.jpg HTTP/1.1" 201 0
2025-12-04 10:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3586152-4001126-1002.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3586152-4001126-1002.jpg saved to cache
2025-12-04 10:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 962271fe-0bbf-54ca-9150-79ce7988e6d2
2025-12-04 10:09:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc54e6d0>
2025-12-04 10:09:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:09:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_962271fe-0bbf-54ca-9150-79ce7988e6d2/962271fe-0bbf-54ca-9150-79ce7988e6d2_image_18.jpg HTTP/1.1" 201 0
2025-12-04 10:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3586152-4001126-1004.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3586152-4001126-1004.jpg saved to cache
2025-12-04 10:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 962271fe-0bbf-54ca-9150-79ce7988e6d2
2025-12-04 10:09:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd31990>
2025-12-04 10:09:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:09:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7f84569-fb89-55b3-a802-892df2beffaa/a7f84569-fb89-55b3-a802-892df2beffaa_image_16.jpg HTTP/1.1" 201 0
2025-12-04 10:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-358707-4006467-1002.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-358707-4006467-1002.jpg saved to cache
2025-12-04 10:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item a7f84569-fb89-55b3-a802-892df2beffaa
2025-12-04 10:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fae7b19cc-e5bb-440c-8d81-5262cf48127c_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ae7b19cc-e5bb-440c-8d81-5262cf48127c_ext_5.jpg not downloaded yet
2025-12-04 10:09:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-358707-4006467-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000358707-01985076-002.pdf)
2025-12-04 10:09:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/ae7b19cc-e5bb-440c-8d81-5262cf48127c_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003571047-01943040-001.pdf)
2025-12-04 10:09:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a6af1569-55dc-4d66-88da-768b58bbe966_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000358707-01985076-002.pdf)
2025-12-04 10:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fae7b19cc-e5bb-440c-8d81-5262cf48127c_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ae7b19cc-e5bb-440c-8d81-5262cf48127c_ext_3.jpg not downloaded yet
2025-12-04 10:09:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-358707-4006467-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000358707-01985076-002.pdf)
2025-12-04 10:09:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3586152-4001126-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003586152-01984713-003.pdf)
2025-12-04 10:09:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3586152-4001126-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003586152-01984713-003.pdf)
2025-12-04 10:09:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-358707-4006467-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000358707-01985076-002.pdf)
2025-12-04 10:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fae7b19cc-e5bb-440c-8d81-5262cf48127c_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ae7b19cc-e5bb-440c-8d81-5262cf48127c_ext_4.jpg not downloaded yet
2025-12-04 10:09:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3586152-4001126-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003586152-01984713-003.pdf)
2025-12-04 10:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3571047-4006998-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3571047-4006998-13.jpg not downloaded yet
2025-12-04 10:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3571047-4006998-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3571047-4006998-1000.jpg not downloaded yet
2025-12-04 10:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3571047-4006998-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3571047-4006998-1001.jpg not downloaded yet
2025-12-04 10:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3571047-4006998-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3571047-4006998-1002.jpg not downloaded yet
2025-12-04 10:09:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccfcfb50>
2025-12-04 10:09:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 10:09:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7f84569-fb89-55b3-a802-892df2beffaa/a7f84569-fb89-55b3-a802-892df2beffaa_image_15.jpg HTTP/1.1" 201 0
2025-12-04 10:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-358707-4006467-1001.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-358707-4006467-1001.jpg saved to cache
2025-12-04 10:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item a7f84569-fb89-55b3-a802-892df2beffaa
2025-12-04 10:09:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccfb9490>
2025-12-04 10:09:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:09:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f/3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f_image_1.jpg HTTP/1.1" 201 0
2025-12-04 10:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fae7b19cc-e5bb-440c-8d81-5262cf48127c_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ae7b19cc-e5bb-440c-8d81-5262cf48127c_ext_7.jpg saved to cache
2025-12-04 10:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f
2025-12-04 10:09:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6194d0>
2025-12-04 10:09:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:09:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7f84569-fb89-55b3-a802-892df2beffaa/a7f84569-fb89-55b3-a802-892df2beffaa_image_12.jpg HTTP/1.1" 201 0
2025-12-04 10:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa6af1569-55dc-4d66-88da-768b58bbe966_ext_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a6af1569-55dc-4d66-88da-768b58bbe966_ext_4.jpg saved to cache
2025-12-04 10:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item a7f84569-fb89-55b3-a802-892df2beffaa
2025-12-04 10:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3571047-4006998-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3571047-4006998-1003.jpg not downloaded yet
2025-12-04 10:09:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf17790>
2025-12-04 10:09:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:09:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7f84569-fb89-55b3-a802-892df2beffaa/a7f84569-fb89-55b3-a802-892df2beffaa_image_14.jpg HTTP/1.1" 201 0
2025-12-04 10:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-358707-4006467-1000.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-358707-4006467-1000.jpg saved to cache
2025-12-04 10:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item a7f84569-fb89-55b3-a802-892df2beffaa
2025-12-04 10:09:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc7de090>
2025-12-04 10:09:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:09:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_962271fe-0bbf-54ca-9150-79ce7988e6d2/962271fe-0bbf-54ca-9150-79ce7988e6d2_image_15.jpg HTTP/1.1" 201 0
2025-12-04 10:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3586152-4001126-1001.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3586152-4001126-1001.jpg saved to cache
2025-12-04 10:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 962271fe-0bbf-54ca-9150-79ce7988e6d2
2025-12-04 10:09:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6d78d0>
2025-12-04 10:09:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:09:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_962271fe-0bbf-54ca-9150-79ce7988e6d2/962271fe-0bbf-54ca-9150-79ce7988e6d2_image_14.jpg HTTP/1.1" 201 0
2025-12-04 10:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3586152-4001126-1000.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3586152-4001126-1000.jpg saved to cache
2025-12-04 10:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 962271fe-0bbf-54ca-9150-79ce7988e6d2
2025-12-04 10:09:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf17d10>
2025-12-04 10:09:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:09:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7f84569-fb89-55b3-a802-892df2beffaa/a7f84569-fb89-55b3-a802-892df2beffaa_image_13.jpg HTTP/1.1" 201 0
2025-12-04 10:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-358707-4006467-13.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-358707-4006467-13.jpg saved to cache
2025-12-04 10:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item a7f84569-fb89-55b3-a802-892df2beffaa
2025-12-04 10:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3571047-4006998-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3571047-4006998-1004.jpg not downloaded yet
2025-12-04 10:09:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e9857e45-5435-4551-8081-6777c7e1be35_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003586152-01984713-003.pdf)
2025-12-04 10:09:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a6af1569-55dc-4d66-88da-768b58bbe966_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000358707-01985076-002.pdf)
2025-12-04 10:09:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/ae7b19cc-e5bb-440c-8d81-5262cf48127c_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003571047-01943040-001.pdf)
2025-12-04 10:09:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/ae7b19cc-e5bb-440c-8d81-5262cf48127c_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003571047-01943040-001.pdf)
2025-12-04 10:09:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/ae7b19cc-e5bb-440c-8d81-5262cf48127c_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003571047-01943040-001.pdf)
2025-12-04 10:09:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/ae7b19cc-e5bb-440c-8d81-5262cf48127c_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003571047-01943040-001.pdf)
2025-12-04 10:09:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e9857e45-5435-4551-8081-6777c7e1be35_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003586152-01984713-003.pdf)
2025-12-04 10:09:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/ae7b19cc-e5bb-440c-8d81-5262cf48127c_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003571047-01943040-001.pdf)
2025-12-04 10:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3571047-4006998-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3571047-4006998-1005.jpg not downloaded yet
2025-12-04 10:09:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc603790>
2025-12-04 10:09:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:09:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_962271fe-0bbf-54ca-9150-79ce7988e6d2/962271fe-0bbf-54ca-9150-79ce7988e6d2_image_13.jpg HTTP/1.1" 201 0
2025-12-04 10:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3586152-4001126-13.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3586152-4001126-13.jpg saved to cache
2025-12-04 10:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 962271fe-0bbf-54ca-9150-79ce7988e6d2
2025-12-04 10:09:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/ae7b19cc-e5bb-440c-8d81-5262cf48127c_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003571047-01943040-001.pdf)
2025-12-04 10:09:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/ae7b19cc-e5bb-440c-8d81-5262cf48127c_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003571047-01943040-001.pdf)
2025-12-04 10:09:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd8a990>
2025-12-04 10:09:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:09:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_962271fe-0bbf-54ca-9150-79ce7988e6d2/962271fe-0bbf-54ca-9150-79ce7988e6d2_image_11.jpg HTTP/1.1" 201 0
2025-12-04 10:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe9857e45-5435-4551-8081-6777c7e1be35_ext_3.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e9857e45-5435-4551-8081-6777c7e1be35_ext_3.jpg saved to cache
2025-12-04 10:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 962271fe-0bbf-54ca-9150-79ce7988e6d2
2025-12-04 10:09:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc650190>
2025-12-04 10:09:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:09:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7f84569-fb89-55b3-a802-892df2beffaa/a7f84569-fb89-55b3-a802-892df2beffaa_image_11.jpg HTTP/1.1" 201 0
2025-12-04 10:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa6af1569-55dc-4d66-88da-768b58bbe966_ext_3.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a6af1569-55dc-4d66-88da-768b58bbe966_ext_3.jpg saved to cache
2025-12-04 10:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item a7f84569-fb89-55b3-a802-892df2beffaa
2025-12-04 10:09:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce01f90>
2025-12-04 10:09:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:09:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f/3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f_image_9.jpg HTTP/1.1" 201 0
2025-12-04 10:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fae7b19cc-e5bb-440c-8d81-5262cf48127c_ext_2.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ae7b19cc-e5bb-440c-8d81-5262cf48127c_ext_2.jpg saved to cache
2025-12-04 10:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f
2025-12-04 10:09:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccefdc50>
2025-12-04 10:09:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:09:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f/3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f_image_7.jpg HTTP/1.1" 201 0
2025-12-04 10:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fae7b19cc-e5bb-440c-8d81-5262cf48127c_10.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ae7b19cc-e5bb-440c-8d81-5262cf48127c_10.jpg saved to cache
2025-12-04 10:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f
2025-12-04 10:09:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccfd1710>
2025-12-04 10:09:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:09:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f/3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f_image_10.jpg HTTP/1.1" 201 0
2025-12-04 10:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fae7b19cc-e5bb-440c-8d81-5262cf48127c_ext_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ae7b19cc-e5bb-440c-8d81-5262cf48127c_ext_5.jpg saved to cache
2025-12-04 10:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f
2025-12-04 10:09:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce650d0>
2025-12-04 10:09:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:09:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f/3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f_image_0.jpg HTTP/1.1" 201 0
2025-12-04 10:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fae7b19cc-e5bb-440c-8d81-5262cf48127c_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ae7b19cc-e5bb-440c-8d81-5262cf48127c_ext_7.jpg saved to cache
2025-12-04 10:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f
2025-12-04 10:09:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc69a510>
2025-12-04 10:09:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 10:09:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_962271fe-0bbf-54ca-9150-79ce7988e6d2/962271fe-0bbf-54ca-9150-79ce7988e6d2_image_12.jpg HTTP/1.1" 201 0
2025-12-04 10:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe9857e45-5435-4551-8081-6777c7e1be35_ext_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e9857e45-5435-4551-8081-6777c7e1be35_ext_4.jpg saved to cache
2025-12-04 10:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 962271fe-0bbf-54ca-9150-79ce7988e6d2
2025-12-04 10:09:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6e0bd0>
2025-12-04 10:09:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:09:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f/3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f_image_8.jpg HTTP/1.1" 201 0
2025-12-04 10:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fae7b19cc-e5bb-440c-8d81-5262cf48127c_9.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ae7b19cc-e5bb-440c-8d81-5262cf48127c_9.jpg saved to cache
2025-12-04 10:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f
2025-12-04 10:09:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf85490>
2025-12-04 10:09:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:09:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f/3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f_image_6.jpg HTTP/1.1" 201 0
2025-12-04 10:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fae7b19cc-e5bb-440c-8d81-5262cf48127c_11.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ae7b19cc-e5bb-440c-8d81-5262cf48127c_11.jpg saved to cache
2025-12-04 10:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f
2025-12-04 10:09:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5c3c10>
2025-12-04 10:09:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:09:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f/3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f_image_5.jpg HTTP/1.1" 201 0
2025-12-04 10:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fae7b19cc-e5bb-440c-8d81-5262cf48127c_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ae7b19cc-e5bb-440c-8d81-5262cf48127c_4.jpg saved to cache
2025-12-04 10:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f
2025-12-04 10:09:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/ae7b19cc-e5bb-440c-8d81-5262cf48127c_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003571047-01943040-001.pdf)
2025-12-04 10:09:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3571047-4006998-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003571047-01943040-001.pdf)
2025-12-04 10:09:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3571047-4006998-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003571047-01943040-001.pdf)
2025-12-04 10:09:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3571047-4006998-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003571047-01943040-001.pdf)
2025-12-04 10:09:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3571047-4006998-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003571047-01943040-001.pdf)
2025-12-04 10:09:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3571047-4006998-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003571047-01943040-001.pdf)
2025-12-04 10:09:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3571047-4006998-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003571047-01943040-001.pdf)
2025-12-04 10:09:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd80d10>
2025-12-04 10:09:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:09:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f/3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f_image_12.jpg HTTP/1.1" 201 0
2025-12-04 10:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fae7b19cc-e5bb-440c-8d81-5262cf48127c_ext_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ae7b19cc-e5bb-440c-8d81-5262cf48127c_ext_4.jpg saved to cache
2025-12-04 10:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f
2025-12-04 10:09:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/ae7b19cc-e5bb-440c-8d81-5262cf48127c_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003571047-01943040-001.pdf)
2025-12-04 10:09:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/ae7b19cc-e5bb-440c-8d81-5262cf48127c_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003571047-01943040-001.pdf)
2025-12-04 10:09:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc59dd90>
2025-12-04 10:09:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:09:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f/3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f_image_18.jpg HTTP/1.1" 201 0
2025-12-04 10:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3571047-4006998-1004.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3571047-4006998-1004.jpg saved to cache
2025-12-04 10:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f
2025-12-04 10:09:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc7e0d10>
2025-12-04 10:09:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:09:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f/3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f_image_16.jpg HTTP/1.1" 201 0
2025-12-04 10:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3571047-4006998-1002.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3571047-4006998-1002.jpg saved to cache
2025-12-04 10:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f
2025-12-04 10:09:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf5a190>
2025-12-04 10:09:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:09:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f/3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f_image_13.jpg HTTP/1.1" 201 0
2025-12-04 10:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3571047-4006998-13.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3571047-4006998-13.jpg saved to cache
2025-12-04 10:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f
2025-12-04 10:09:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5ea510>
2025-12-04 10:09:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:09:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f/3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f_image_17.jpg HTTP/1.1" 201 0
2025-12-04 10:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3571047-4006998-1003.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3571047-4006998-1003.jpg saved to cache
2025-12-04 10:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f
2025-12-04 10:09:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5e80d0>
2025-12-04 10:09:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:09:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f/3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f_image_19.jpg HTTP/1.1" 201 0
2025-12-04 10:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3571047-4006998-1005.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3571047-4006998-1005.jpg saved to cache
2025-12-04 10:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f
2025-12-04 10:09:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc7dd810>
2025-12-04 10:09:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:09:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f/3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f_image_15.jpg HTTP/1.1" 201 0
2025-12-04 10:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3571047-4006998-1001.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3571047-4006998-1001.jpg saved to cache
2025-12-04 10:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f
2025-12-04 10:09:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3571047-4006998-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003571047-01943040-001.pdf)
2025-12-04 10:09:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e9857e45-5435-4551-8081-6777c7e1be35_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003586152-01984713-003.pdf)
2025-12-04 10:09:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/ae7b19cc-e5bb-440c-8d81-5262cf48127c_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003571047-01943040-001.pdf)
2025-12-04 10:09:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/ae7b19cc-e5bb-440c-8d81-5262cf48127c_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003571047-01943040-001.pdf)
2025-12-04 10:09:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a6af1569-55dc-4d66-88da-768b58bbe966_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000358707-01985076-002.pdf)
2025-12-04 10:09:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a6af1569-55dc-4d66-88da-768b58bbe966_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000358707-01985076-002.pdf)
2025-12-04 10:09:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccde9c50>
2025-12-04 10:09:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:09:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f/3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f_image_3.jpg HTTP/1.1" 201 0
2025-12-04 10:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fae7b19cc-e5bb-440c-8d81-5262cf48127c_ext_1.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ae7b19cc-e5bb-440c-8d81-5262cf48127c_ext_1.jpg saved to cache
2025-12-04 10:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f
2025-12-04 10:09:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd062b10>
2025-12-04 10:09:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:09:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f/3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f_image_2.jpg HTTP/1.1" 201 0
2025-12-04 10:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fae7b19cc-e5bb-440c-8d81-5262cf48127c_ext_6.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ae7b19cc-e5bb-440c-8d81-5262cf48127c_ext_6.jpg saved to cache
2025-12-04 10:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f
2025-12-04 10:09:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a6af1569-55dc-4d66-88da-768b58bbe966_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000358707-01985076-002.pdf)
2025-12-04 10:09:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a6af1569-55dc-4d66-88da-768b58bbe966_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000358707-01985076-002.pdf)
2025-12-04 10:09:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a6af1569-55dc-4d66-88da-768b58bbe966_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000358707-01985076-002.pdf)
2025-12-04 10:09:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e9857e45-5435-4551-8081-6777c7e1be35_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003586152-01984713-003.pdf)
2025-12-04 10:09:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a6af1569-55dc-4d66-88da-768b58bbe966_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000358707-01985076-002.pdf)
2025-12-04 10:09:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e9857e45-5435-4551-8081-6777c7e1be35_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003586152-01984713-003.pdf)
2025-12-04 10:09:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e9857e45-5435-4551-8081-6777c7e1be35_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003586152-01984713-003.pdf)
2025-12-04 10:09:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e9857e45-5435-4551-8081-6777c7e1be35_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003586152-01984713-003.pdf)
2025-12-04 10:09:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc566ad0>
2025-12-04 10:09:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:09:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f/3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f_image_14.jpg HTTP/1.1" 201 0
2025-12-04 10:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3571047-4006998-1000.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3571047-4006998-1000.jpg saved to cache
2025-12-04 10:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f
2025-12-04 10:09:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc7dcad0>
2025-12-04 10:09:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:09:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_962271fe-0bbf-54ca-9150-79ce7988e6d2/962271fe-0bbf-54ca-9150-79ce7988e6d2_image_10.jpg HTTP/1.1" 201 0
2025-12-04 10:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe9857e45-5435-4551-8081-6777c7e1be35_ext_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e9857e45-5435-4551-8081-6777c7e1be35_ext_5.jpg saved to cache
2025-12-04 10:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 962271fe-0bbf-54ca-9150-79ce7988e6d2
2025-12-04 10:09:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ce7bdb50>
2025-12-04 10:09:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:09:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f/3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f_image_4.jpg HTTP/1.1" 201 0
2025-12-04 10:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fae7b19cc-e5bb-440c-8d81-5262cf48127c_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ae7b19cc-e5bb-440c-8d81-5262cf48127c_5.jpg saved to cache
2025-12-04 10:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f
2025-12-04 10:09:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5ea890>
2025-12-04 10:09:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:09:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f/3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f_image_11.jpg HTTP/1.1" 201 0
2025-12-04 10:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fae7b19cc-e5bb-440c-8d81-5262cf48127c_ext_3.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ae7b19cc-e5bb-440c-8d81-5262cf48127c_ext_3.jpg saved to cache
2025-12-04 10:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f
2025-12-04 10:09:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f, skipping ID generation
2025-12-04 10:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f from tracking dictionaries
2025-12-04 10:09:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f sending to next pipeline
2025-12-04 10:09:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f, identifier: 3571047
2025-12-04 10:09:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc7e17d0>
2025-12-04 10:09:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:09:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7f84569-fb89-55b3-a802-892df2beffaa/a7f84569-fb89-55b3-a802-892df2beffaa_image_10.jpg HTTP/1.1" 201 0
2025-12-04 10:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa6af1569-55dc-4d66-88da-768b58bbe966_ext_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a6af1569-55dc-4d66-88da-768b58bbe966_ext_5.jpg saved to cache
2025-12-04 10:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item a7f84569-fb89-55b3-a802-892df2beffaa
2025-12-04 10:09:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6c4e90>
2025-12-04 10:09:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:09:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7f84569-fb89-55b3-a802-892df2beffaa/a7f84569-fb89-55b3-a802-892df2beffaa_image_9.jpg HTTP/1.1" 201 0
2025-12-04 10:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa6af1569-55dc-4d66-88da-768b58bbe966_ext_2.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a6af1569-55dc-4d66-88da-768b58bbe966_ext_2.jpg saved to cache
2025-12-04 10:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a7f84569-fb89-55b3-a802-892df2beffaa
2025-12-04 10:09:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f with identifier: 3571047
2025-12-04 10:09:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f with identifier: 3571047
2025-12-04 10:09:41 [scrapy.core.scraper] INFO: Dropped: Dropping expired listing: 3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f with expiration date: 2025-12-04T09:00:00Z
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f/3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f_expert_report_file_fec6137e-01b6-428f-93fc-3d7816c3f85f.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003571047-01943040-001.pdf',
 'color': 'SILVER',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'EX62DYP',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/NISSAN/MICRA?id=3571047',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'NISSAN',
 'model': 'MICRA',
 'odometer': 86695,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 47,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f/3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 240796,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/ae7b19cc-e5bb-440c-8d81-5262cf48127c_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f/3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 240796,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/ae7b19cc-e5bb-440c-8d81-5262cf48127c_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f/3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 129897,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/ae7b19cc-e5bb-440c-8d81-5262cf48127c_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f/3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120838,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/ae7b19cc-e5bb-440c-8d81-5262cf48127c_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f/3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 173531,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/ae7b19cc-e5bb-440c-8d81-5262cf48127c_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f/3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 185180,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/ae7b19cc-e5bb-440c-8d81-5262cf48127c_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f/3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 188901,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/ae7b19cc-e5bb-440c-8d81-5262cf48127c_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f/3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 178624,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/ae7b19cc-e5bb-440c-8d81-5262cf48127c_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f/3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 204616,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/ae7b19cc-e5bb-440c-8d81-5262cf48127c_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f/3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 186935,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/ae7b19cc-e5bb-440c-8d81-5262cf48127c_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f/3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 136524,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/ae7b19cc-e5bb-440c-8d81-5262cf48127c_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f/3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 170650,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/ae7b19cc-e5bb-440c-8d81-5262cf48127c_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f/3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 134915,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/ae7b19cc-e5bb-440c-8d81-5262cf48127c_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f/3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 316389,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3571047-4006998-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f/3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 422340,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3571047-4006998-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f/3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 185836,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3571047-4006998-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f/3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 211342,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3571047-4006998-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f/3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 306883,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3571047-4006998-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f/3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 239095,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3571047-4006998-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f/3ddf5dee-7c8a-5b5b-81fa-bf2e6825ee5f_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 332723,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3571047-4006998-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-31',
 'seller_name': None,
 'title': 'NISSAN MICRA 1.2 Visia 5dr',
 'transmission': 'manual',
 'trim': '1.2 Visia 5dr',
 'year': 2012}
2025-12-04 10:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273571047%27 HTTP/1.1" 200 None
2025-12-04 10:09:41 [manheim.gb] INFO: Saving data for 3571047: {'created_time': 1764842981.310986, 'last_price_update_time': 1764842981.310994, 'auction_closing_time': 1764838800.0}
2025-12-04 10:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3571047') HTTP/1.1" 204 0
2025-12-04 10:09:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a6af1569-55dc-4d66-88da-768b58bbe966_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000358707-01985076-002.pdf)
2025-12-04 10:09:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e9857e45-5435-4551-8081-6777c7e1be35_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003586152-01984713-003.pdf)
2025-12-04 10:09:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e9857e45-5435-4551-8081-6777c7e1be35_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003586152-01984713-003.pdf)
2025-12-04 10:09:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e9857e45-5435-4551-8081-6777c7e1be35_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003586152-01984713-003.pdf)
2025-12-04 10:09:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a6af1569-55dc-4d66-88da-768b58bbe966_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000358707-01985076-002.pdf)
2025-12-04 10:09:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5c3010>
2025-12-04 10:09:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:09:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7f84569-fb89-55b3-a802-892df2beffaa/a7f84569-fb89-55b3-a802-892df2beffaa_image_8.jpg HTTP/1.1" 201 0
2025-12-04 10:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa6af1569-55dc-4d66-88da-768b58bbe966_9.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a6af1569-55dc-4d66-88da-768b58bbe966_9.jpg saved to cache
2025-12-04 10:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a7f84569-fb89-55b3-a802-892df2beffaa
2025-12-04 10:09:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5c86d0>
2025-12-04 10:09:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:09:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7f84569-fb89-55b3-a802-892df2beffaa/a7f84569-fb89-55b3-a802-892df2beffaa_image_7.jpg HTTP/1.1" 201 0
2025-12-04 10:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa6af1569-55dc-4d66-88da-768b58bbe966_10.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a6af1569-55dc-4d66-88da-768b58bbe966_10.jpg saved to cache
2025-12-04 10:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a7f84569-fb89-55b3-a802-892df2beffaa
2025-12-04 10:09:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6d7250>
2025-12-04 10:09:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:09:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7f84569-fb89-55b3-a802-892df2beffaa/a7f84569-fb89-55b3-a802-892df2beffaa_image_6.jpg HTTP/1.1" 201 0
2025-12-04 10:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa6af1569-55dc-4d66-88da-768b58bbe966_11.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a6af1569-55dc-4d66-88da-768b58bbe966_11.jpg saved to cache
2025-12-04 10:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a7f84569-fb89-55b3-a802-892df2beffaa
2025-12-04 10:09:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce50c10>
2025-12-04 10:09:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:09:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_962271fe-0bbf-54ca-9150-79ce7988e6d2/962271fe-0bbf-54ca-9150-79ce7988e6d2_image_6.jpg HTTP/1.1" 201 0
2025-12-04 10:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe9857e45-5435-4551-8081-6777c7e1be35_11.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e9857e45-5435-4551-8081-6777c7e1be35_11.jpg saved to cache
2025-12-04 10:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 962271fe-0bbf-54ca-9150-79ce7988e6d2
2025-12-04 10:09:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc57bb50>
2025-12-04 10:09:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:09:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7f84569-fb89-55b3-a802-892df2beffaa/a7f84569-fb89-55b3-a802-892df2beffaa_image_5.jpg HTTP/1.1" 201 0
2025-12-04 10:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa6af1569-55dc-4d66-88da-768b58bbe966_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a6af1569-55dc-4d66-88da-768b58bbe966_4.jpg saved to cache
2025-12-04 10:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a7f84569-fb89-55b3-a802-892df2beffaa
2025-12-04 10:09:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccc9c0d0>
2025-12-04 10:09:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:09:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_962271fe-0bbf-54ca-9150-79ce7988e6d2/962271fe-0bbf-54ca-9150-79ce7988e6d2_image_9.jpg HTTP/1.1" 201 0
2025-12-04 10:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe9857e45-5435-4551-8081-6777c7e1be35_ext_2.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e9857e45-5435-4551-8081-6777c7e1be35_ext_2.jpg saved to cache
2025-12-04 10:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 962271fe-0bbf-54ca-9150-79ce7988e6d2
2025-12-04 10:09:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cd091850>
2025-12-04 10:09:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:09:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_962271fe-0bbf-54ca-9150-79ce7988e6d2/962271fe-0bbf-54ca-9150-79ce7988e6d2_image_8.jpg HTTP/1.1" 201 0
2025-12-04 10:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe9857e45-5435-4551-8081-6777c7e1be35_9.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e9857e45-5435-4551-8081-6777c7e1be35_9.jpg saved to cache
2025-12-04 10:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 962271fe-0bbf-54ca-9150-79ce7988e6d2
2025-12-04 10:09:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce01a10>
2025-12-04 10:09:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:09:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_962271fe-0bbf-54ca-9150-79ce7988e6d2/962271fe-0bbf-54ca-9150-79ce7988e6d2_image_7.jpg HTTP/1.1" 201 0
2025-12-04 10:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe9857e45-5435-4551-8081-6777c7e1be35_10.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e9857e45-5435-4551-8081-6777c7e1be35_10.jpg saved to cache
2025-12-04 10:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 962271fe-0bbf-54ca-9150-79ce7988e6d2
2025-12-04 10:09:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e9857e45-5435-4551-8081-6777c7e1be35_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003586152-01984713-003.pdf)
2025-12-04 10:09:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a6af1569-55dc-4d66-88da-768b58bbe966_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000358707-01985076-002.pdf)
2025-12-04 10:09:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a6af1569-55dc-4d66-88da-768b58bbe966_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000358707-01985076-002.pdf)
2025-12-04 10:09:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e9857e45-5435-4551-8081-6777c7e1be35_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003586152-01984713-003.pdf)
2025-12-04 10:09:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a6af1569-55dc-4d66-88da-768b58bbe966_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000358707-01985076-002.pdf)
2025-12-04 10:09:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cccd1710>
2025-12-04 10:09:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:09:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7f84569-fb89-55b3-a802-892df2beffaa/a7f84569-fb89-55b3-a802-892df2beffaa_image_4.jpg HTTP/1.1" 201 0
2025-12-04 10:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa6af1569-55dc-4d66-88da-768b58bbe966_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a6af1569-55dc-4d66-88da-768b58bbe966_5.jpg saved to cache
2025-12-04 10:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a7f84569-fb89-55b3-a802-892df2beffaa
2025-12-04 10:09:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc6a4ed0>
2025-12-04 10:09:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:09:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_962271fe-0bbf-54ca-9150-79ce7988e6d2/962271fe-0bbf-54ca-9150-79ce7988e6d2_image_3.jpg HTTP/1.1" 201 0
2025-12-04 10:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe9857e45-5435-4551-8081-6777c7e1be35_ext_1.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e9857e45-5435-4551-8081-6777c7e1be35_ext_1.jpg saved to cache
2025-12-04 10:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 962271fe-0bbf-54ca-9150-79ce7988e6d2
2025-12-04 10:09:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc53e790>
2025-12-04 10:09:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:09:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_962271fe-0bbf-54ca-9150-79ce7988e6d2/962271fe-0bbf-54ca-9150-79ce7988e6d2_image_5.jpg HTTP/1.1" 201 0
2025-12-04 10:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe9857e45-5435-4551-8081-6777c7e1be35_4.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e9857e45-5435-4551-8081-6777c7e1be35_4.jpg saved to cache
2025-12-04 10:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 962271fe-0bbf-54ca-9150-79ce7988e6d2
2025-12-04 10:09:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc564f90>
2025-12-04 10:09:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:09:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_962271fe-0bbf-54ca-9150-79ce7988e6d2/962271fe-0bbf-54ca-9150-79ce7988e6d2_image_4.jpg HTTP/1.1" 201 0
2025-12-04 10:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe9857e45-5435-4551-8081-6777c7e1be35_5.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e9857e45-5435-4551-8081-6777c7e1be35_5.jpg saved to cache
2025-12-04 10:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 962271fe-0bbf-54ca-9150-79ce7988e6d2
2025-12-04 10:09:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf0a7d0>
2025-12-04 10:09:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:09:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7f84569-fb89-55b3-a802-892df2beffaa/a7f84569-fb89-55b3-a802-892df2beffaa_image_3.jpg HTTP/1.1" 201 0
2025-12-04 10:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa6af1569-55dc-4d66-88da-768b58bbe966_ext_1.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a6af1569-55dc-4d66-88da-768b58bbe966_ext_1.jpg saved to cache
2025-12-04 10:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a7f84569-fb89-55b3-a802-892df2beffaa
2025-12-04 10:09:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e9857e45-5435-4551-8081-6777c7e1be35_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003586152-01984713-003.pdf)
2025-12-04 10:09:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cccb3b10>
2025-12-04 10:09:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 10:09:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_962271fe-0bbf-54ca-9150-79ce7988e6d2/962271fe-0bbf-54ca-9150-79ce7988e6d2_image_2.jpg HTTP/1.1" 201 0
2025-12-04 10:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe9857e45-5435-4551-8081-6777c7e1be35_ext_6.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e9857e45-5435-4551-8081-6777c7e1be35_ext_6.jpg saved to cache
2025-12-04 10:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 962271fe-0bbf-54ca-9150-79ce7988e6d2
2025-12-04 10:09:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf9d650>
2025-12-04 10:09:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:09:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7f84569-fb89-55b3-a802-892df2beffaa/a7f84569-fb89-55b3-a802-892df2beffaa_image_1.jpg HTTP/1.1" 201 0
2025-12-04 10:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa6af1569-55dc-4d66-88da-768b58bbe966_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a6af1569-55dc-4d66-88da-768b58bbe966_ext_7.jpg saved to cache
2025-12-04 10:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a7f84569-fb89-55b3-a802-892df2beffaa
2025-12-04 10:09:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccc83690>
2025-12-04 10:09:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:09:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7f84569-fb89-55b3-a802-892df2beffaa/a7f84569-fb89-55b3-a802-892df2beffaa_image_2.jpg HTTP/1.1" 201 0
2025-12-04 10:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa6af1569-55dc-4d66-88da-768b58bbe966_ext_6.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a6af1569-55dc-4d66-88da-768b58bbe966_ext_6.jpg saved to cache
2025-12-04 10:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a7f84569-fb89-55b3-a802-892df2beffaa
2025-12-04 10:09:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf685d0>
2025-12-04 10:09:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:09:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_962271fe-0bbf-54ca-9150-79ce7988e6d2/962271fe-0bbf-54ca-9150-79ce7988e6d2_image_1.jpg HTTP/1.1" 201 0
2025-12-04 10:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe9857e45-5435-4551-8081-6777c7e1be35_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e9857e45-5435-4551-8081-6777c7e1be35_ext_7.jpg saved to cache
2025-12-04 10:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 962271fe-0bbf-54ca-9150-79ce7988e6d2
2025-12-04 10:09:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccdd3d50>
2025-12-04 10:09:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:09:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7f84569-fb89-55b3-a802-892df2beffaa/a7f84569-fb89-55b3-a802-892df2beffaa_image_0.jpg HTTP/1.1" 201 0
2025-12-04 10:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa6af1569-55dc-4d66-88da-768b58bbe966_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a6af1569-55dc-4d66-88da-768b58bbe966_ext_7.jpg saved to cache
2025-12-04 10:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a7f84569-fb89-55b3-a802-892df2beffaa
2025-12-04 10:09:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a7f84569-fb89-55b3-a802-892df2beffaa, skipping ID generation
2025-12-04 10:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a7f84569-fb89-55b3-a802-892df2beffaa from tracking dictionaries
2025-12-04 10:09:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a7f84569-fb89-55b3-a802-892df2beffaa sending to next pipeline
2025-12-04 10:09:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: a7f84569-fb89-55b3-a802-892df2beffaa, identifier: 358707
2025-12-04 10:09:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: a7f84569-fb89-55b3-a802-892df2beffaa with identifier: 358707
2025-12-04 10:09:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: a7f84569-fb89-55b3-a802-892df2beffaa with identifier: 358707
2025-12-04 10:09:46 [scrapy.core.scraper] INFO: Dropped: Dropping expired listing: a7f84569-fb89-55b3-a802-892df2beffaa with expiration date: 2025-12-04T09:00:00Z
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7f84569-fb89-55b3-a802-892df2beffaa/a7f84569-fb89-55b3-a802-892df2beffaa_expert_report_file_edec9391-2796-4fc0-93e3-fea54c442497.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0000358707-01985076-002.pdf',
 'color': 'SILVER',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'a7f84569-fb89-55b3-a802-892df2beffaa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'YB64WEK',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/PEUGEOT/108?id=358707',
 'listing': 'auction',
 'location': 'Leeds',
 'make': 'PEUGEOT',
 'model': '108',
 'odometer': 62761,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 36,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7f84569-fb89-55b3-a802-892df2beffaa/a7f84569-fb89-55b3-a802-892df2beffaa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 223632,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a6af1569-55dc-4d66-88da-768b58bbe966_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7f84569-fb89-55b3-a802-892df2beffaa/a7f84569-fb89-55b3-a802-892df2beffaa_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 223632,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a6af1569-55dc-4d66-88da-768b58bbe966_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7f84569-fb89-55b3-a802-892df2beffaa/a7f84569-fb89-55b3-a802-892df2beffaa_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 239156,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a6af1569-55dc-4d66-88da-768b58bbe966_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7f84569-fb89-55b3-a802-892df2beffaa/a7f84569-fb89-55b3-a802-892df2beffaa_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 249481,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a6af1569-55dc-4d66-88da-768b58bbe966_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7f84569-fb89-55b3-a802-892df2beffaa/a7f84569-fb89-55b3-a802-892df2beffaa_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 171919,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a6af1569-55dc-4d66-88da-768b58bbe966_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7f84569-fb89-55b3-a802-892df2beffaa/a7f84569-fb89-55b3-a802-892df2beffaa_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 190307,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a6af1569-55dc-4d66-88da-768b58bbe966_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7f84569-fb89-55b3-a802-892df2beffaa/a7f84569-fb89-55b3-a802-892df2beffaa_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 159288,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a6af1569-55dc-4d66-88da-768b58bbe966_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7f84569-fb89-55b3-a802-892df2beffaa/a7f84569-fb89-55b3-a802-892df2beffaa_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 176705,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a6af1569-55dc-4d66-88da-768b58bbe966_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7f84569-fb89-55b3-a802-892df2beffaa/a7f84569-fb89-55b3-a802-892df2beffaa_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 183042,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a6af1569-55dc-4d66-88da-768b58bbe966_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7f84569-fb89-55b3-a802-892df2beffaa/a7f84569-fb89-55b3-a802-892df2beffaa_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 251579,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a6af1569-55dc-4d66-88da-768b58bbe966_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7f84569-fb89-55b3-a802-892df2beffaa/a7f84569-fb89-55b3-a802-892df2beffaa_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 199955,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a6af1569-55dc-4d66-88da-768b58bbe966_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7f84569-fb89-55b3-a802-892df2beffaa/a7f84569-fb89-55b3-a802-892df2beffaa_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 191393,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a6af1569-55dc-4d66-88da-768b58bbe966_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7f84569-fb89-55b3-a802-892df2beffaa/a7f84569-fb89-55b3-a802-892df2beffaa_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 234846,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a6af1569-55dc-4d66-88da-768b58bbe966_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7f84569-fb89-55b3-a802-892df2beffaa/a7f84569-fb89-55b3-a802-892df2beffaa_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 373683,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-358707-4006467-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7f84569-fb89-55b3-a802-892df2beffaa/a7f84569-fb89-55b3-a802-892df2beffaa_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 276799,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-358707-4006467-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7f84569-fb89-55b3-a802-892df2beffaa/a7f84569-fb89-55b3-a802-892df2beffaa_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 157215,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-358707-4006467-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7f84569-fb89-55b3-a802-892df2beffaa/a7f84569-fb89-55b3-a802-892df2beffaa_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 263176,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-358707-4006467-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7f84569-fb89-55b3-a802-892df2beffaa/a7f84569-fb89-55b3-a802-892df2beffaa_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 212462,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-358707-4006467-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7f84569-fb89-55b3-a802-892df2beffaa/a7f84569-fb89-55b3-a802-892df2beffaa_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 137807,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-358707-4006467-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7f84569-fb89-55b3-a802-892df2beffaa/a7f84569-fb89-55b3-a802-892df2beffaa_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 153962,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-358707-4006467-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-29',
 'seller_name': 'Pentagon Group',
 'title': 'PEUGEOT 108 1.2 VTi Allure 5dr',
 'transmission': 'manual',
 'trim': '1.2 VTi Allure 5dr',
 'year': 2014}
2025-12-04 10:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27358707%27 HTTP/1.1" 200 None
2025-12-04 10:09:46 [manheim.gb] INFO: Saving data for 358707: {'created_time': 1764842986.298712, 'last_price_update_time': 1764842986.298722, 'auction_closing_time': 1764838800.0}
2025-12-04 10:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='358707') HTTP/1.1" 204 0
2025-12-04 10:09:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:09:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:09:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:09:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cce24c50>
2025-12-04 10:09:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:09:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:09:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:09:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:09:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:09:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:09:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_962271fe-0bbf-54ca-9150-79ce7988e6d2/962271fe-0bbf-54ca-9150-79ce7988e6d2_image_0.jpg HTTP/1.1" 201 0
2025-12-04 10:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe9857e45-5435-4551-8081-6777c7e1be35_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 10:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e9857e45-5435-4551-8081-6777c7e1be35_ext_7.jpg saved to cache
2025-12-04 10:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 962271fe-0bbf-54ca-9150-79ce7988e6d2
2025-12-04 10:09:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 962271fe-0bbf-54ca-9150-79ce7988e6d2, skipping ID generation
2025-12-04 10:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 962271fe-0bbf-54ca-9150-79ce7988e6d2 from tracking dictionaries
2025-12-04 10:09:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 962271fe-0bbf-54ca-9150-79ce7988e6d2 sending to next pipeline
2025-12-04 10:09:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 962271fe-0bbf-54ca-9150-79ce7988e6d2, identifier: 3586152
2025-12-04 10:09:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 962271fe-0bbf-54ca-9150-79ce7988e6d2 with identifier: 3586152
2025-12-04 10:09:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-04 10:09:46 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Diesel%2FHybrid HTTP/1.1" 200 None
2025-12-04 10:09:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-04 10:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-04 10:09:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 962271fe-0bbf-54ca-9150-79ce7988e6d2 with identifier: 3586152
2025-12-04 10:09:47 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 962271fe-0bbf-54ca-9150-79ce7988e6d2 with identifier: 3586152 to the API
2025-12-04 10:09:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 10:09:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 10:09:47 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/e9857e45-5435-4551-8081-6777c7e1be35_ext_7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 184,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_962271fe-0bbf-54ca-9150-79ce7988e6d2/962271fe-0bbf-54ca-9150-79ce7988e6d2_expert_report_file_6fbb0748-7563-4d4d-ade5-dbd21bc55068.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003586152-01984713-003.pdf',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Diesel/Hybrid',
 'id': '962271fe-0bbf-54ca-9150-79ce7988e6d2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'YY71HGG',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VOLVO/XC90?id=3586152',
 'listing': 'auction',
 'location': 'Birmingham',
 'make': 'VOLVO',
 'model': 'XC90',
 'odometer': 68014,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 34,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_962271fe-0bbf-54ca-9150-79ce7988e6d2/962271fe-0bbf-54ca-9150-79ce7988e6d2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 200816,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e9857e45-5435-4551-8081-6777c7e1be35_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_962271fe-0bbf-54ca-9150-79ce7988e6d2/962271fe-0bbf-54ca-9150-79ce7988e6d2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 200816,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e9857e45-5435-4551-8081-6777c7e1be35_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_962271fe-0bbf-54ca-9150-79ce7988e6d2/962271fe-0bbf-54ca-9150-79ce7988e6d2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 172545,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e9857e45-5435-4551-8081-6777c7e1be35_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_962271fe-0bbf-54ca-9150-79ce7988e6d2/962271fe-0bbf-54ca-9150-79ce7988e6d2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 158310,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e9857e45-5435-4551-8081-6777c7e1be35_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_962271fe-0bbf-54ca-9150-79ce7988e6d2/962271fe-0bbf-54ca-9150-79ce7988e6d2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 205490,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e9857e45-5435-4551-8081-6777c7e1be35_5.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_962271fe-0bbf-54ca-9150-79ce7988e6d2/962271fe-0bbf-54ca-9150-79ce7988e6d2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 202803,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e9857e45-5435-4551-8081-6777c7e1be35_4.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_962271fe-0bbf-54ca-9150-79ce7988e6d2/962271fe-0bbf-54ca-9150-79ce7988e6d2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 193926,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e9857e45-5435-4551-8081-6777c7e1be35_11.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_962271fe-0bbf-54ca-9150-79ce7988e6d2/962271fe-0bbf-54ca-9150-79ce7988e6d2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 203891,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e9857e45-5435-4551-8081-6777c7e1be35_10.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_962271fe-0bbf-54ca-9150-79ce7988e6d2/962271fe-0bbf-54ca-9150-79ce7988e6d2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 229446,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e9857e45-5435-4551-8081-6777c7e1be35_9.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_962271fe-0bbf-54ca-9150-79ce7988e6d2/962271fe-0bbf-54ca-9150-79ce7988e6d2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 220444,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e9857e45-5435-4551-8081-6777c7e1be35_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_962271fe-0bbf-54ca-9150-79ce7988e6d2/962271fe-0bbf-54ca-9150-79ce7988e6d2_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 140190,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e9857e45-5435-4551-8081-6777c7e1be35_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_962271fe-0bbf-54ca-9150-79ce7988e6d2/962271fe-0bbf-54ca-9150-79ce7988e6d2_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 188954,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e9857e45-5435-4551-8081-6777c7e1be35_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_962271fe-0bbf-54ca-9150-79ce7988e6d2/962271fe-0bbf-54ca-9150-79ce7988e6d2_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 201829,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e9857e45-5435-4551-8081-6777c7e1be35_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_962271fe-0bbf-54ca-9150-79ce7988e6d2/962271fe-0bbf-54ca-9150-79ce7988e6d2_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 434973,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3586152-4001126-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_962271fe-0bbf-54ca-9150-79ce7988e6d2/962271fe-0bbf-54ca-9150-79ce7988e6d2_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 344152,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3586152-4001126-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_962271fe-0bbf-54ca-9150-79ce7988e6d2/962271fe-0bbf-54ca-9150-79ce7988e6d2_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 363123,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3586152-4001126-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_962271fe-0bbf-54ca-9150-79ce7988e6d2/962271fe-0bbf-54ca-9150-79ce7988e6d2_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 316439,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3586152-4001126-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_962271fe-0bbf-54ca-9150-79ce7988e6d2/962271fe-0bbf-54ca-9150-79ce7988e6d2_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 131115,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3586152-4001126-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_962271fe-0bbf-54ca-9150-79ce7988e6d2/962271fe-0bbf-54ca-9150-79ce7988e6d2_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 297798,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3586152-4001126-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_962271fe-0bbf-54ca-9150-79ce7988e6d2/962271fe-0bbf-54ca-9150-79ce7988e6d2_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 248038,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3586152-4001126-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-08',
 'seller_name': None,
 'title': 'VOLVO XC90 2.0 B5D [235] Inscription 5dr AWD Geartronic',
 'transmission': 'automatic',
 'trim': '2.0 B5D [235] Inscription 5dr AWD Geartronic',
 'year': 2021}
2025-12-04 10:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273586152%27 HTTP/1.1" 200 None
2025-12-04 10:09:47 [manheim.gb] INFO: Saving data for 3586152: {'created_time': 1764842987.296262, 'last_price_update_time': 1764842987.296273, 'auction_closing_time': 1765184400.0}
2025-12-04 10:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3586152') HTTP/1.1" 204 0
2025-12-04 10:10:25 [scrapy.extensions.logstats] INFO: Crawled 157 pages (at -4 pages/min), scraped 45 items (at 1 items/min)
2025-12-04 10:10:53 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.043(s), this was the 1st time calling it.
2025-12-04 10:10:53 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.254882637534882 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-04 10:10:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2025-12-04 10:11:25 [scrapy.extensions.logstats] INFO: Crawled 157 pages (at 0 pages/min), scraped 45 items (at 0 items/min)
2025-12-04 10:12:25 [scrapy.extensions.logstats] INFO: Crawled 157 pages (at 0 pages/min), scraped 45 items (at 0 items/min)
2025-12-04 10:12:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VAUXHALL/CORSA?id=3583550&returnUrl=%2Fsearch%3FPage%3D4%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233583550&indx=303> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 10:12:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50833df2-ee39-5d02-926f-61549921de1d with identifier: 3583550
2025-12-04 10:12:31 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 50833df2-ee39-5d02-926f-61549921de1d
2025-12-04 10:12:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003583550-41-83636111-001.pdf> (referer: None)
2025-12-04 10:12:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:12:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:12:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:12:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc68c690>
2025-12-04 10:12:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:12:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:12:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:12:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:12:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:12:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:12:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50833df2-ee39-5d02-926f-61549921de1d/50833df2-ee39-5d02-926f-61549921de1d_expert_report_file_46add5a9-c060-4a48-9159-661d2f0a7ece.pdf HTTP/1.1" 201 0
2025-12-04 10:12:32 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 50833df2-ee39-5d02-926f-61549921de1d
2025-12-04 10:12:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 50833df2-ee39-5d02-926f-61549921de1d, skipping ID generation
2025-12-04 10:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 50833df2-ee39-5d02-926f-61549921de1d
2025-12-04 10:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3583550-3528945-1.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://images.manheim.co.uk/images/units/zoom/insp-0001-3583550-3528945-1.jpg not downloaded yet
2025-12-04 10:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3583550-3528945-2.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://images.manheim.co.uk/images/units/zoom/insp-0001-3583550-3528945-2.jpg not downloaded yet
2025-12-04 10:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3583550-3528945-3.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://images.manheim.co.uk/images/units/zoom/insp-0001-3583550-3528945-3.jpg not downloaded yet
2025-12-04 10:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3583550-3528945-4.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://images.manheim.co.uk/images/units/zoom/insp-0001-3583550-3528945-4.jpg not downloaded yet
2025-12-04 10:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3583550-3528945-6.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://images.manheim.co.uk/images/units/zoom/insp-0001-3583550-3528945-6.jpg not downloaded yet
2025-12-04 10:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3583550-3528945-8.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://images.manheim.co.uk/images/units/zoom/insp-0001-3583550-3528945-8.jpg not downloaded yet
2025-12-04 10:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3583550-3528945-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://images.manheim.co.uk/images/units/zoom/insp-0001-3583550-3528945-13.jpg not downloaded yet
2025-12-04 10:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3583550-3528945-16.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://images.manheim.co.uk/images/units/zoom/insp-0001-3583550-3528945-16.jpg not downloaded yet
2025-12-04 10:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3583550-3528945-28.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://images.manheim.co.uk/images/units/zoom/insp-0001-3583550-3528945-28.jpg not downloaded yet
2025-12-04 10:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3583550-3528945-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://images.manheim.co.uk/images/units/zoom/insp-0001-3583550-3528945-1000.jpg not downloaded yet
2025-12-04 10:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3583550-3528945-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://images.manheim.co.uk/images/units/zoom/insp-0001-3583550-3528945-1001.jpg not downloaded yet
2025-12-04 10:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3583550-3528945-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://images.manheim.co.uk/images/units/zoom/insp-0001-3583550-3528945-1002.jpg not downloaded yet
2025-12-04 10:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3583550-3528945-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://images.manheim.co.uk/images/units/zoom/insp-0001-3583550-3528945-1003.jpg not downloaded yet
2025-12-04 10:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3583550-3528945-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://images.manheim.co.uk/images/units/zoom/insp-0001-3583550-3528945-1004.jpg not downloaded yet
2025-12-04 10:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3583550-3528945-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://images.manheim.co.uk/images/units/zoom/insp-0001-3583550-3528945-1005.jpg not downloaded yet
2025-12-04 10:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3583550-3528945-1006.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://images.manheim.co.uk/images/units/zoom/insp-0001-3583550-3528945-1006.jpg not downloaded yet
2025-12-04 10:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3583550-3528945-1007.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://images.manheim.co.uk/images/units/zoom/insp-0001-3583550-3528945-1007.jpg not downloaded yet
2025-12-04 10:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3583550-3528945-1008.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://images.manheim.co.uk/images/units/zoom/insp-0001-3583550-3528945-1008.jpg not downloaded yet
2025-12-04 10:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3583550-3528945-1009.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://images.manheim.co.uk/images/units/zoom/insp-0001-3583550-3528945-1009.jpg not downloaded yet
2025-12-04 10:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3583550-3528945-1010.jpg%27 HTTP/1.1" 200 None
2025-12-04 10:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://images.manheim.co.uk/images/units/zoom/insp-0001-3583550-3528945-1010.jpg not downloaded yet
2025-12-04 10:12:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://images.manheim.co.uk/images/units/zoom/insp-0001-3583550-3528945-2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003583550-41-83636111-001.pdf)
2025-12-04 10:12:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://images.manheim.co.uk/images/units/zoom/insp-0001-3583550-3528945-4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003583550-41-83636111-001.pdf)
2025-12-04 10:12:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://images.manheim.co.uk/images/units/zoom/insp-0001-3583550-3528945-1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003583550-41-83636111-001.pdf)
2025-12-04 10:12:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://images.manheim.co.uk/images/units/zoom/insp-0001-3583550-3528945-8.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003583550-41-83636111-001.pdf)
2025-12-04 10:12:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://images.manheim.co.uk/images/units/zoom/insp-0001-3583550-3528945-3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003583550-41-83636111-001.pdf)
2025-12-04 10:12:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:12:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:12:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:12:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5ea290>
2025-12-04 10:12:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:12:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:12:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:12:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:12:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:12:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:12:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50833df2-ee39-5d02-926f-61549921de1d/50833df2-ee39-5d02-926f-61549921de1d_image_1.jpg HTTP/1.1" 201 0
2025-12-04 10:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='https%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3583550-3528945-2.jpg') HTTP/1.1" 204 0
2025-12-04 10:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://images.manheim.co.uk/images/units/zoom/insp-0001-3583550-3528945-2.jpg saved to cache
2025-12-04 10:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 50833df2-ee39-5d02-926f-61549921de1d
2025-12-04 10:12:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://images.manheim.co.uk/images/units/zoom/insp-0001-3583550-3528945-28.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003583550-41-83636111-001.pdf)
2025-12-04 10:12:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://images.manheim.co.uk/images/units/zoom/insp-0001-3583550-3528945-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003583550-41-83636111-001.pdf)
2025-12-04 10:12:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:12:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:12:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:12:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc7f7d10>
2025-12-04 10:12:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:12:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:12:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:12:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:12:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:12:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:12:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50833df2-ee39-5d02-926f-61549921de1d/50833df2-ee39-5d02-926f-61549921de1d_image_3.jpg HTTP/1.1" 201 0
2025-12-04 10:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='https%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3583550-3528945-4.jpg') HTTP/1.1" 204 0
2025-12-04 10:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://images.manheim.co.uk/images/units/zoom/insp-0001-3583550-3528945-4.jpg saved to cache
2025-12-04 10:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 50833df2-ee39-5d02-926f-61549921de1d
2025-12-04 10:12:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:12:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:12:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:12:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd1ee10>
2025-12-04 10:12:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:12:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:12:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:12:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:12:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:12:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:12:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50833df2-ee39-5d02-926f-61549921de1d/50833df2-ee39-5d02-926f-61549921de1d_image_0.jpg HTTP/1.1" 201 0
2025-12-04 10:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='https%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3583550-3528945-1.jpg') HTTP/1.1" 204 0
2025-12-04 10:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://images.manheim.co.uk/images/units/zoom/insp-0001-3583550-3528945-1.jpg saved to cache
2025-12-04 10:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 50833df2-ee39-5d02-926f-61549921de1d
2025-12-04 10:12:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:12:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:12:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:12:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd4a090>
2025-12-04 10:12:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:12:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:12:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:12:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:12:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:12:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:12:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50833df2-ee39-5d02-926f-61549921de1d/50833df2-ee39-5d02-926f-61549921de1d_image_5.jpg HTTP/1.1" 201 0
2025-12-04 10:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='https%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3583550-3528945-8.jpg') HTTP/1.1" 204 0
2025-12-04 10:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://images.manheim.co.uk/images/units/zoom/insp-0001-3583550-3528945-8.jpg saved to cache
2025-12-04 10:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 50833df2-ee39-5d02-926f-61549921de1d
2025-12-04 10:12:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:12:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:12:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:12:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc5ac390>
2025-12-04 10:12:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:12:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:12:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:12:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:12:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:12:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:12:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50833df2-ee39-5d02-926f-61549921de1d/50833df2-ee39-5d02-926f-61549921de1d_image_2.jpg HTTP/1.1" 201 0
2025-12-04 10:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='https%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3583550-3528945-3.jpg') HTTP/1.1" 204 0
2025-12-04 10:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://images.manheim.co.uk/images/units/zoom/insp-0001-3583550-3528945-3.jpg saved to cache
2025-12-04 10:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 50833df2-ee39-5d02-926f-61549921de1d
2025-12-04 10:12:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://images.manheim.co.uk/images/units/zoom/insp-0001-3583550-3528945-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003583550-41-83636111-001.pdf)
2025-12-04 10:12:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://images.manheim.co.uk/images/units/zoom/insp-0001-3583550-3528945-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003583550-41-83636111-001.pdf)
2025-12-04 10:12:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://images.manheim.co.uk/images/units/zoom/insp-0001-3583550-3528945-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003583550-41-83636111-001.pdf)
2025-12-04 10:12:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://images.manheim.co.uk/images/units/zoom/insp-0001-3583550-3528945-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003583550-41-83636111-001.pdf)
2025-12-04 10:12:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://images.manheim.co.uk/images/units/zoom/insp-0001-3583550-3528945-6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003583550-41-83636111-001.pdf)
2025-12-04 10:12:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://images.manheim.co.uk/images/units/zoom/insp-0001-3583550-3528945-16.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003583550-41-83636111-001.pdf)
2025-12-04 10:12:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:12:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:12:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:12:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc671c50>
2025-12-04 10:12:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:12:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:12:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:12:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:12:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:12:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:12:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50833df2-ee39-5d02-926f-61549921de1d/50833df2-ee39-5d02-926f-61549921de1d_image_8.jpg HTTP/1.1" 201 0
2025-12-04 10:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='https%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3583550-3528945-28.jpg') HTTP/1.1" 204 0
2025-12-04 10:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://images.manheim.co.uk/images/units/zoom/insp-0001-3583550-3528945-28.jpg saved to cache
2025-12-04 10:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 50833df2-ee39-5d02-926f-61549921de1d
2025-12-04 10:12:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:12:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:12:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:12:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf16d10>
2025-12-04 10:12:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:12:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:12:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:12:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:12:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:12:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:12:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50833df2-ee39-5d02-926f-61549921de1d/50833df2-ee39-5d02-926f-61549921de1d_image_9.jpg HTTP/1.1" 201 0
2025-12-04 10:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='https%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3583550-3528945-1000.jpg') HTTP/1.1" 204 0
2025-12-04 10:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://images.manheim.co.uk/images/units/zoom/insp-0001-3583550-3528945-1000.jpg saved to cache
2025-12-04 10:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 50833df2-ee39-5d02-926f-61549921de1d
2025-12-04 10:12:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://images.manheim.co.uk/images/units/zoom/insp-0001-3583550-3528945-1008.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003583550-41-83636111-001.pdf)
2025-12-04 10:12:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:12:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:12:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:12:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccec5e50>
2025-12-04 10:12:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:12:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:12:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:12:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:12:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:12:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:12:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50833df2-ee39-5d02-926f-61549921de1d/50833df2-ee39-5d02-926f-61549921de1d_image_6.jpg HTTP/1.1" 201 0
2025-12-04 10:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='https%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3583550-3528945-13.jpg') HTTP/1.1" 204 0
2025-12-04 10:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://images.manheim.co.uk/images/units/zoom/insp-0001-3583550-3528945-13.jpg saved to cache
2025-12-04 10:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 50833df2-ee39-5d02-926f-61549921de1d
2025-12-04 10:12:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:12:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:12:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:12:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccd817d0>
2025-12-04 10:12:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:12:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:12:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:12:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:12:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:12:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:12:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50833df2-ee39-5d02-926f-61549921de1d/50833df2-ee39-5d02-926f-61549921de1d_image_10.jpg HTTP/1.1" 201 0
2025-12-04 10:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='https%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3583550-3528945-1001.jpg') HTTP/1.1" 204 0
2025-12-04 10:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://images.manheim.co.uk/images/units/zoom/insp-0001-3583550-3528945-1001.jpg saved to cache
2025-12-04 10:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 50833df2-ee39-5d02-926f-61549921de1d
2025-12-04 10:12:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:12:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:12:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:12:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccec4950>
2025-12-04 10:12:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:12:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:12:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:12:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:12:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:12:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:12:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50833df2-ee39-5d02-926f-61549921de1d/50833df2-ee39-5d02-926f-61549921de1d_image_11.jpg HTTP/1.1" 201 0
2025-12-04 10:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='https%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3583550-3528945-1002.jpg') HTTP/1.1" 204 0
2025-12-04 10:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://images.manheim.co.uk/images/units/zoom/insp-0001-3583550-3528945-1002.jpg saved to cache
2025-12-04 10:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 50833df2-ee39-5d02-926f-61549921de1d
2025-12-04 10:12:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:12:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:12:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:12:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccc4a110>
2025-12-04 10:12:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:12:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:12:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 10:12:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:12:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:12:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:12:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50833df2-ee39-5d02-926f-61549921de1d/50833df2-ee39-5d02-926f-61549921de1d_image_12.jpg HTTP/1.1" 201 0
2025-12-04 10:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='https%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3583550-3528945-1003.jpg') HTTP/1.1" 204 0
2025-12-04 10:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://images.manheim.co.uk/images/units/zoom/insp-0001-3583550-3528945-1003.jpg saved to cache
2025-12-04 10:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 50833df2-ee39-5d02-926f-61549921de1d
2025-12-04 10:12:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:12:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:12:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:12:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccec6410>
2025-12-04 10:12:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:12:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:12:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:12:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:12:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:12:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:12:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50833df2-ee39-5d02-926f-61549921de1d/50833df2-ee39-5d02-926f-61549921de1d_image_4.jpg HTTP/1.1" 201 0
2025-12-04 10:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='https%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3583550-3528945-6.jpg') HTTP/1.1" 204 0
2025-12-04 10:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://images.manheim.co.uk/images/units/zoom/insp-0001-3583550-3528945-6.jpg saved to cache
2025-12-04 10:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 50833df2-ee39-5d02-926f-61549921de1d
2025-12-04 10:12:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:12:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:12:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:12:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccc5f150>
2025-12-04 10:12:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:12:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:12:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:12:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:12:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:12:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:12:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50833df2-ee39-5d02-926f-61549921de1d/50833df2-ee39-5d02-926f-61549921de1d_image_7.jpg HTTP/1.1" 201 0
2025-12-04 10:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='https%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3583550-3528945-16.jpg') HTTP/1.1" 204 0
2025-12-04 10:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://images.manheim.co.uk/images/units/zoom/insp-0001-3583550-3528945-16.jpg saved to cache
2025-12-04 10:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 50833df2-ee39-5d02-926f-61549921de1d
2025-12-04 10:12:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://images.manheim.co.uk/images/units/zoom/insp-0001-3583550-3528945-1006.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003583550-41-83636111-001.pdf)
2025-12-04 10:12:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://images.manheim.co.uk/images/units/zoom/insp-0001-3583550-3528945-1009.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003583550-41-83636111-001.pdf)
2025-12-04 10:12:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://images.manheim.co.uk/images/units/zoom/insp-0001-3583550-3528945-1010.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003583550-41-83636111-001.pdf)
2025-12-04 10:12:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://images.manheim.co.uk/images/units/zoom/insp-0001-3583550-3528945-1007.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003583550-41-83636111-001.pdf)
2025-12-04 10:12:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://images.manheim.co.uk/images/units/zoom/insp-0001-3583550-3528945-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003583550-41-83636111-001.pdf)
2025-12-04 10:12:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://images.manheim.co.uk/images/units/zoom/insp-0001-3583550-3528945-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003583550-41-83636111-001.pdf)
2025-12-04 10:12:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:12:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:12:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:12:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc599550>
2025-12-04 10:12:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:12:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:12:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 10:12:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:12:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:12:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:12:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50833df2-ee39-5d02-926f-61549921de1d/50833df2-ee39-5d02-926f-61549921de1d_image_17.jpg HTTP/1.1" 201 0
2025-12-04 10:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='https%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3583550-3528945-1008.jpg') HTTP/1.1" 204 0
2025-12-04 10:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://images.manheim.co.uk/images/units/zoom/insp-0001-3583550-3528945-1008.jpg saved to cache
2025-12-04 10:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 50833df2-ee39-5d02-926f-61549921de1d
2025-12-04 10:12:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:12:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:12:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:12:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc564410>
2025-12-04 10:12:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:12:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:12:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:12:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:12:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:12:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:12:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50833df2-ee39-5d02-926f-61549921de1d/50833df2-ee39-5d02-926f-61549921de1d_image_15.jpg HTTP/1.1" 201 0
2025-12-04 10:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='https%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3583550-3528945-1006.jpg') HTTP/1.1" 204 0
2025-12-04 10:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://images.manheim.co.uk/images/units/zoom/insp-0001-3583550-3528945-1006.jpg saved to cache
2025-12-04 10:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 50833df2-ee39-5d02-926f-61549921de1d
2025-12-04 10:12:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:12:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:12:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:12:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc597410>
2025-12-04 10:12:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:12:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:12:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:12:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:12:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:12:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:12:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50833df2-ee39-5d02-926f-61549921de1d/50833df2-ee39-5d02-926f-61549921de1d_image_18.jpg HTTP/1.1" 201 0
2025-12-04 10:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='https%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3583550-3528945-1009.jpg') HTTP/1.1" 204 0
2025-12-04 10:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://images.manheim.co.uk/images/units/zoom/insp-0001-3583550-3528945-1009.jpg saved to cache
2025-12-04 10:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 50833df2-ee39-5d02-926f-61549921de1d
2025-12-04 10:12:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:12:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:12:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:12:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccec7310>
2025-12-04 10:12:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:12:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:12:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:12:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:12:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:12:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:12:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50833df2-ee39-5d02-926f-61549921de1d/50833df2-ee39-5d02-926f-61549921de1d_image_19.jpg HTTP/1.1" 201 0
2025-12-04 10:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='https%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3583550-3528945-1010.jpg') HTTP/1.1" 204 0
2025-12-04 10:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://images.manheim.co.uk/images/units/zoom/insp-0001-3583550-3528945-1010.jpg saved to cache
2025-12-04 10:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 50833df2-ee39-5d02-926f-61549921de1d
2025-12-04 10:12:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:12:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:12:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:12:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc596050>
2025-12-04 10:12:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:12:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:12:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 10:12:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:12:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:12:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:12:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50833df2-ee39-5d02-926f-61549921de1d/50833df2-ee39-5d02-926f-61549921de1d_image_16.jpg HTTP/1.1" 201 0
2025-12-04 10:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='https%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3583550-3528945-1007.jpg') HTTP/1.1" 204 0
2025-12-04 10:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://images.manheim.co.uk/images/units/zoom/insp-0001-3583550-3528945-1007.jpg saved to cache
2025-12-04 10:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 50833df2-ee39-5d02-926f-61549921de1d
2025-12-04 10:12:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:12:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:12:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:12:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5ccf0b590>
2025-12-04 10:12:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:12:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:12:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 10:12:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:12:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:12:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:12:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50833df2-ee39-5d02-926f-61549921de1d/50833df2-ee39-5d02-926f-61549921de1d_image_14.jpg HTTP/1.1" 201 0
2025-12-04 10:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='https%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3583550-3528945-1005.jpg') HTTP/1.1" 204 0
2025-12-04 10:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://images.manheim.co.uk/images/units/zoom/insp-0001-3583550-3528945-1005.jpg saved to cache
2025-12-04 10:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 50833df2-ee39-5d02-926f-61549921de1d
2025-12-04 10:12:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 10:12:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 10:12:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 10:12:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5cc566190>
2025-12-04 10:12:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 10:12:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 10:12:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 10:12:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 10:12:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 10:12:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 10:12:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50833df2-ee39-5d02-926f-61549921de1d/50833df2-ee39-5d02-926f-61549921de1d_image_13.jpg HTTP/1.1" 201 0
2025-12-04 10:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='https%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3583550-3528945-1004.jpg') HTTP/1.1" 204 0
2025-12-04 10:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://images.manheim.co.uk/images/units/zoom/insp-0001-3583550-3528945-1004.jpg saved to cache
2025-12-04 10:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 50833df2-ee39-5d02-926f-61549921de1d
2025-12-04 10:12:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 50833df2-ee39-5d02-926f-61549921de1d, skipping ID generation
2025-12-04 10:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 50833df2-ee39-5d02-926f-61549921de1d from tracking dictionaries
2025-12-04 10:12:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 50833df2-ee39-5d02-926f-61549921de1d sending to next pipeline
2025-12-04 10:12:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 50833df2-ee39-5d02-926f-61549921de1d, identifier: 3583550
2025-12-04 10:12:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 50833df2-ee39-5d02-926f-61549921de1d with identifier: 3583550
2025-12-04 10:12:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 50833df2-ee39-5d02-926f-61549921de1d with identifier: 3583550
2025-12-04 10:12:39 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 50833df2-ee39-5d02-926f-61549921de1d with identifier: 3583550 to the API
2025-12-04 10:12:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 10:12:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 10:12:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://images.manheim.co.uk/images/units/zoom/insp-0001-3583550-3528945-1004.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50833df2-ee39-5d02-926f-61549921de1d/50833df2-ee39-5d02-926f-61549921de1d_expert_report_file_46add5a9-c060-4a48-9159-661d2f0a7ece.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003583550-41-83636111-001.pdf',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': '2025-12-12T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '50833df2-ee39-5d02-926f-61549921de1d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'WD20FFE',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VAUXHALL/CORSA?id=3583550',
 'listing': 'auction',
 'location': 'Birmingham',
 'make': 'VAUXHALL',
 'model': 'CORSA',
 'odometer': 45262,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 24,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50833df2-ee39-5d02-926f-61549921de1d/50833df2-ee39-5d02-926f-61549921de1d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 514742,
             'Height': 1000,
             'OriginUrl': 'https://images.manheim.co.uk/images/units/zoom/insp-0001-3583550-3528945-1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50833df2-ee39-5d02-926f-61549921de1d/50833df2-ee39-5d02-926f-61549921de1d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 266394,
             'Height': 1000,
             'OriginUrl': 'https://images.manheim.co.uk/images/units/zoom/insp-0001-3583550-3528945-2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50833df2-ee39-5d02-926f-61549921de1d/50833df2-ee39-5d02-926f-61549921de1d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 140885,
             'Height': 1000,
             'OriginUrl': 'https://images.manheim.co.uk/images/units/zoom/insp-0001-3583550-3528945-3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50833df2-ee39-5d02-926f-61549921de1d/50833df2-ee39-5d02-926f-61549921de1d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 398993,
             'Height': 1000,
             'OriginUrl': 'https://images.manheim.co.uk/images/units/zoom/insp-0001-3583550-3528945-4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50833df2-ee39-5d02-926f-61549921de1d/50833df2-ee39-5d02-926f-61549921de1d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 437656,
             'Height': 1000,
             'OriginUrl': 'https://images.manheim.co.uk/images/units/zoom/insp-0001-3583550-3528945-6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50833df2-ee39-5d02-926f-61549921de1d/50833df2-ee39-5d02-926f-61549921de1d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 422759,
             'Height': 1000,
             'OriginUrl': 'https://images.manheim.co.uk/images/units/zoom/insp-0001-3583550-3528945-8.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50833df2-ee39-5d02-926f-61549921de1d/50833df2-ee39-5d02-926f-61549921de1d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 409760,
             'Height': 1000,
             'OriginUrl': 'https://images.manheim.co.uk/images/units/zoom/insp-0001-3583550-3528945-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50833df2-ee39-5d02-926f-61549921de1d/50833df2-ee39-5d02-926f-61549921de1d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 262824,
             'Height': 1000,
             'OriginUrl': 'https://images.manheim.co.uk/images/units/zoom/insp-0001-3583550-3528945-16.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50833df2-ee39-5d02-926f-61549921de1d/50833df2-ee39-5d02-926f-61549921de1d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 195546,
             'Height': 1000,
             'OriginUrl': 'https://images.manheim.co.uk/images/units/zoom/insp-0001-3583550-3528945-28.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50833df2-ee39-5d02-926f-61549921de1d/50833df2-ee39-5d02-926f-61549921de1d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 247494,
             'Height': 1000,
             'OriginUrl': 'https://images.manheim.co.uk/images/units/zoom/insp-0001-3583550-3528945-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50833df2-ee39-5d02-926f-61549921de1d/50833df2-ee39-5d02-926f-61549921de1d_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 280362,
             'Height': 1000,
             'OriginUrl': 'https://images.manheim.co.uk/images/units/zoom/insp-0001-3583550-3528945-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50833df2-ee39-5d02-926f-61549921de1d/50833df2-ee39-5d02-926f-61549921de1d_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 306165,
             'Height': 1000,
             'OriginUrl': 'https://images.manheim.co.uk/images/units/zoom/insp-0001-3583550-3528945-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50833df2-ee39-5d02-926f-61549921de1d/50833df2-ee39-5d02-926f-61549921de1d_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 262552,
             'Height': 1000,
             'OriginUrl': 'https://images.manheim.co.uk/images/units/zoom/insp-0001-3583550-3528945-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50833df2-ee39-5d02-926f-61549921de1d/50833df2-ee39-5d02-926f-61549921de1d_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 304321,
             'Height': 1000,
             'OriginUrl': 'https://images.manheim.co.uk/images/units/zoom/insp-0001-3583550-3528945-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50833df2-ee39-5d02-926f-61549921de1d/50833df2-ee39-5d02-926f-61549921de1d_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 343310,
             'Height': 1000,
             'OriginUrl': 'https://images.manheim.co.uk/images/units/zoom/insp-0001-3583550-3528945-1005.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50833df2-ee39-5d02-926f-61549921de1d/50833df2-ee39-5d02-926f-61549921de1d_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 311440,
             'Height': 1000,
             'OriginUrl': 'https://images.manheim.co.uk/images/units/zoom/insp-0001-3583550-3528945-1006.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50833df2-ee39-5d02-926f-61549921de1d/50833df2-ee39-5d02-926f-61549921de1d_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 348769,
             'Height': 1000,
             'OriginUrl': 'https://images.manheim.co.uk/images/units/zoom/insp-0001-3583550-3528945-1007.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50833df2-ee39-5d02-926f-61549921de1d/50833df2-ee39-5d02-926f-61549921de1d_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 250024,
             'Height': 1000,
             'OriginUrl': 'https://images.manheim.co.uk/images/units/zoom/insp-0001-3583550-3528945-1008.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50833df2-ee39-5d02-926f-61549921de1d/50833df2-ee39-5d02-926f-61549921de1d_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 293035,
             'Height': 1000,
             'OriginUrl': 'https://images.manheim.co.uk/images/units/zoom/insp-0001-3583550-3528945-1009.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50833df2-ee39-5d02-926f-61549921de1d/50833df2-ee39-5d02-926f-61549921de1d_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 318421,
             'Height': 1000,
             'OriginUrl': 'https://images.manheim.co.uk/images/units/zoom/insp-0001-3583550-3528945-1010.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-27',
 'seller_name': 'Smiths Motor Group',
 'title': 'VAUXHALL CORSA 1.2 Turbo SRi Premium 5dr',
 'transmission': 'manual',
 'trim': '1.2 Turbo SRi Premium 5dr',
 'year': 2020}
2025-12-04 10:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273583550%27 HTTP/1.1" 200 None
2025-12-04 10:12:40 [manheim.gb] INFO: Saving data for 3583550: {'created_time': 1764843160.147088, 'last_price_update_time': 1764843160.147098, 'auction_closing_time': 1765530000.0}
2025-12-04 10:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3583550') HTTP/1.1" 204 0
2025-12-04 10:12:40 [scrapy.core.engine] INFO: Closing spider (finished)
2025-12-04 10:12:40 [manheim.gb] INFO: manheim.gb Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0}
2025-12-04 10:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273770246%27 HTTP/1.1" 200 None
2025-12-04 10:12:40 [manheim.gb] INFO: Saving data for 3770246: {'created_time': 1764843160.318248}
2025-12-04 10:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3770246') HTTP/1.1" 204 0
2025-12-04 10:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273678294%27 HTTP/1.1" 200 None
2025-12-04 10:12:40 [manheim.gb] INFO: Saving data for 3678294: {'created_time': 1764843160.356222}
2025-12-04 10:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3678294') HTTP/1.1" 204 0
2025-12-04 10:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 10:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20last_price_update_time%20lt%201764411160 HTTP/1.1" 200 None
2025-12-04 10:12:40 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (46 items) in: file:///var/lib/scrapyd/items/sourcing_v2/manheim.gb/task_37_2025-12-04T10_00_04.jl
2025-12-04 10:12:40 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 1641484,
 'downloader/request_count': 1272,
 'downloader/request_method_count/GET': 1268,
 'downloader/request_method_count/POST': 4,
 'downloader/response_bytes': 478933166,
 'downloader/response_count': 1272,
 'downloader/response_status_count/200': 1259,
 'downloader/response_status_count/404': 13,
 'elapsed_time_seconds': 734.526204,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2025, 12, 4, 10, 12, 40, 485708, tzinfo=datetime.timezone.utc),
 'item_dropped_count': 29,
 'item_dropped_reasons_count/DropItem': 29,
 'item_scraped_count': 46,
 'log_count/DEBUG': 13756,
 'log_count/ERROR': 10,
 'log_count/INFO': 12233,
 'memusage/max': 210059264,
 'memusage/startup': 127340544,
 'photo_download_count': 1113,
 'playwright/context_count': 1,
 'playwright/context_count/max_concurrent': 1,
 'playwright/context_count/persistent/False': 1,
 'playwright/context_count/remote/False': 1,
 'playwright/page_count': 1,
 'playwright/page_count/max_concurrent': 1,
 'playwright/request_count': 85,
 'playwright/request_count/aborted': 47,
 'playwright/request_count/method/GET': 82,
 'playwright/request_count/method/POST': 3,
 'playwright/request_count/navigation': 4,
 'playwright/request_count/resource_type/document': 4,
 'playwright/request_count/resource_type/font': 8,
 'playwright/request_count/resource_type/image': 41,
 'playwright/request_count/resource_type/script': 22,
 'playwright/request_count/resource_type/stylesheet': 8,
 'playwright/request_count/resource_type/xhr': 2,
 'playwright/response_count': 38,
 'playwright/response_count/method/GET': 35,
 'playwright/response_count/method/POST': 3,
 'playwright/response_count/resource_type/document': 4,
 'playwright/response_count/resource_type/font': 8,
 'playwright/response_count/resource_type/script': 16,
 'playwright/response_count/resource_type/stylesheet': 8,
 'playwright/response_count/resource_type/xhr': 2,
 'request_depth_max': 7,
 'response_received_count': 159,
 'scheduler/dequeued': 1272,
 'scheduler/dequeued/memory': 1272,
 'scheduler/enqueued': 1272,
 'scheduler/enqueued/memory': 1272,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 81,
 'scrapy-zyte-api/error_ratio': 0.012345679012345678,
 'scrapy-zyte-api/errors': 1,
 "scrapy-zyte-api/exception_types/<class 'aiohttp.client_exceptions.ClientConnectorError'>": 1,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 33.74086391807796,
 'scrapy-zyte-api/mean_response_seconds': 33.96591920793581,
 'scrapy-zyte-api/processed': 80,
 'scrapy-zyte-api/request_args/actions': 76,
 'scrapy-zyte-api/request_args/browserHtml': 76,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 4,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 80,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 80,
 'scrapy-zyte-api/request_args/httpRequestBody': 4,
 'scrapy-zyte-api/request_args/httpRequestMethod': 4,
 'scrapy-zyte-api/request_args/httpResponseBody': 4,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 4,
 'scrapy-zyte-api/request_args/requestHeaders': 76,
 'scrapy-zyte-api/request_args/sessionContext': 76,
 'scrapy-zyte-api/request_args/url': 80,
 'scrapy-zyte-api/status_codes/0': 1,
 'scrapy-zyte-api/status_codes/200': 80,
 'scrapy-zyte-api/success': 80,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'spider_exceptions/HttpError': 1,
 'spider_exceptions/ValueError': 1,
 'start_time': datetime.datetime(2025, 12, 4, 10, 0, 25, 959504, tzinfo=datetime.timezone.utc)}
2025-12-04 10:12:40 [scrapy.core.engine] INFO: Spider closed (finished)